JP2023093714A - Contact control program, terminal, and contact control method - Google Patents

Abstract

To provide an artificial intelligence contact control technique that reflects personal schedule and lifestyles.SOLUTION: A contact control method according to an embodiment of the present invention is capable of processing contact requests, such as voice calls, video calls, and/or instant message receptions, which are transmitted to a user from external sources, without requiring user control, by utilizing artificial intelligence (AI) and reflecting the user's schedule and lifestyle.SELECTED DRAWING: Figure 4

Description

The following description relates to artificial intelligence contact control technology that reflects personal schedules and lifestyles, and more particularly, contacts communicated to the user from the outside, such as voice calls, video calls, and/or receiving instant messages. A contact control method that allows artificial intelligence (Artificial Intelligence: AI) to process a request for contact by reflecting the user's schedule and lifestyle, a computer device that executes the contact control method, and a computer The present invention relates to a computer program stored in a computer-readable recording medium for causing a computer to execute a contact control method, and the recording medium.

Electronic devices capable of wired or wireless communication can contact each other by using a voice call service, a video call service, or a service for sending and receiving instant messages. Such a request for contact may be unilaterally transmitted from the sender (originator) to the recipient (called party) without any agreement with the recipient. There are situations that the receiving user cannot accept.

For example, suppose that the sender attempts to make a video call to the receiver, but cannot respond to the video call request because the user on the receiver is in a meeting. In this case, in the prior art, the receiving electronic device outputs a notification to inform the receiving user that the request for the video call has been delivered, and the receiving user reacts to the provided notification. and the electronic device could generate input to accept or reject the video call. At this time, the electronic device could process the making or rejecting of the video call according to the input generated. For example, Patent Document 1 relates to a caller ID display and call rejection method in a mobile communication terminal. After searching the item settings, the menu of reasons for refusal to receive is displayed on the screen display window, the input of the key corresponding to the reason for refusal to receive is detected, and the text message or voice message corresponding to the key is read and sent to the caller. A technique is disclosed for canceling the call after transmission and displaying reception refusal completion on a screen display window.

Korean Patent No. 10-2005-0039

However, in such prior art, in processing the contact request of the sending party at the receiving party, there is no direct control of the user of the receiving party, or a setting preset by the user of the receiving party regarding processing the contact request. There is the problem of requiring configuration information. For example, the user had to directly generate an input for rejection of reception, or directly set information regarding the time period and conditions for automatic rejection of reception. In other words, the prior art has the problem that all the processing related to the transmission of voice calls, video calls, or instant messages must be directly controlled according to the situation of the receiving user.

Artificial intelligence (AI) processing of external contact requests, such as voice calls, video calls, and/or receiving instant messages, reflecting the user's schedule and lifestyle. a computer device for executing the contact control method, a computer program stored in a computer-readable recording medium for causing the computer to execute the contact control method in combination with a computer, and the recording medium. do.

A contact control method comprising the steps of: receiving a contact request from a caller over a network; determining whether said contact request is directly controllable by a called party; processing the contact by using artificial intelligence to converse with the caller of the contact when direct control of the caller is impossible.

A contact control method for a server that provides a service for contact between a caller and a called party, comprising: receiving a contact request from the caller to the called party over a network; determining whether the called party can directly control the request, and if the called party cannot directly control the caller, using artificial intelligence to converse with the caller of the contact to make the contact; and generating and providing summary information of said conversation to said called party.

The computer program is characterized by being stored in a computer-readable recording medium in order to combine with a computer and cause the computer to execute the contact control method.

A computer-readable recording medium characterized by recording a program for causing a computer to execute the contact control method.

A computing device comprising at least one processor implemented to execute computer readable instructions, said at least one processor receiving a request for contact from a caller over a network, and determines whether direct control of the callee is possible in response to the request of the callee, and if the callee cannot be directly controlled, uses artificial intelligence to have a conversation with the caller of the contact to close the contact It is characterized by processing.

1. A computing device for providing services for contact between a caller and a called party, the device comprising at least one processor implemented to execute computer readable instructions, the at least one processor being connected to a network. receiving a contact request from the caller to the called party via and determining whether the called party can directly control the contact request; and if the called party cannot directly control the contact request, It is characterized by using artificial intelligence to have a conversation with the caller of the contact, process the contact, generate summary information of the conversation and provide it to the called party.

Artificial intelligence (AI) processing of external contact requests, such as voice calls, video calls, and/or receiving instant messages, reflecting the user's schedule and lifestyle. can be done.

1 is a diagram showing an example of a network environment in one embodiment of the present invention; FIG. 1 is a block diagram for explaining internal configurations of an electronic device and a server in one embodiment of the present invention; FIG. 1 illustrates an example of a cloud artificial intelligence platform in one embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of an overall process for contact control of an electronic device in one embodiment of the present invention; FIG. 4 illustrates an example of an overall process for contact control of a server in an embodiment of the present invention; FIG. 4 is a diagram showing an example of providing a summary sentence in one embodiment of the present invention; FIG. 4 is a diagram showing an example of providing a summary sentence in one embodiment of the present invention; FIG. 10 is a diagram showing an example in which post-processing operations are performed in one embodiment of the present invention; FIG. 10 illustrates an example user interface for selecting to accept or decline voice calls in one embodiment of the present invention; FIG. 10 is a diagram showing an example of a preview screen displaying a self-portrait image in one embodiment of the present invention; 4 is a flow chart showing an example of a contact control method for an electronic device in one embodiment of the present invention. 1 is a flowchart illustrating an example of using artificial intelligence to process contacts in accordance with one embodiment of the present invention. 4 is a flow chart showing an example of a contact control method of a server in one embodiment of the present invention;

Embodiments will be described in detail below with reference to the accompanying drawings.

A contact control method according to embodiments of the present invention may be performed by a computing device such as an electronic device or a server described below. At this time, the computer program according to one embodiment of the present invention may be installed and driven in the computer device, and the computer device executes the contact control method according to one embodiment of the present invention under the control of the computer program to be driven. can be executed. The computer program described above may be stored in a computer-readable recording medium in order to cause the computer to execute the contact control method in combination with the computer device. For example, under the control of an application installed and driven on the electronic device, the electronic device may receive contact requests communicated externally to the user, such as voice calls, video calls, and/or receiving instant messages. (Artificial Intelligence: AI) may be used to automatically process the user's schedule and lifestyle. Such processing may be performed autonomously by the electronic device under the control of an application installed and driven by the electronic device, or may be performed by a server that provides artificial intelligence functionality depending on the embodiment. good. For example, artificial intelligence can automatically recognize situations in which a user is unable to process a communicated contact request, and based on the recognized situation, automatically process a communicated contact request without requiring user control. can be processed with

FIG. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment of FIG. 1 illustrates an example including multiple electronic devices 110 , 120 , 130 , 140 , multiple servers 150 , 160 , and a network 170 . Such FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited as in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals implemented by computing devices. Examples of the plurality of electronic devices 110, 120, 130, and 140 include smart phones, mobile phones, navigation systems, PCs (personal computers), notebook pan computers, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), tablets, etc. As an example, FIG. 1 shows the shape of a smartphone as an example of the electronic device 1 (110). may refer to one of a variety of physical computing devices capable of communicating with other electronic devices 120 , 130 , 140 and/or servers 150 , 160 via network 170 as a network.

The communication method is not limited, and not only a communication method that utilizes a communication network that can be included in the network 170 (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network), but also a short distance between devices. Wireless communication may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wide area network), a BBN (broadband network). k), such as the Internet Any one or more of the networks may be included. Additionally, network 170 may include any one or more of network topologies including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, etc. It is not limited to these.

Each of servers 150, 160 is implemented by a computer device or a plurality of computer devices that communicate with a plurality of electronic devices 110, 120, 130, 140 via network 170 to provide instructions, code, files, content, services, etc. you can For example, the server 150 may be a system that provides a first service to a plurality of electronic devices 110, 120, 130, 140 connected via the network 170, and the server 160 may also be a system that provides a plurality of electronic devices connected via the network 170. It may be a system that provides the second service to the electronic devices 110 , 120 , 130 , 140 . As a more specific example, the server 150 provides a service (for example, services for processing such contact control methods, voice call services, video call services, search services, information providing services, messaging services, mail services, and/or content transmission services, etc.) as a first service, a plurality of electronic devices 110 , 120, 130, 140. As another example, the server 160 may provide, as a second service, a service for distributing files for installing and running the above-described applications to the plurality of electronic devices 110, 120, 130, and 140. FIG.

FIG. 2 is a block diagram for explaining internal configurations of an electronic device and a server in one embodiment of the present invention. In FIG. 2, the internal configuration of the electronic device 1 (110) and the internal configuration of the server 150 will be described as an example of the electronic device. Other electronic devices 120, 130, 140 and server 160 may also have the same or similar internal configurations as electronic device 1 (110) or server 150 described above.

Electronic device 1 (110) and server 150 may include memories 211, 221, processors 212, 222, communication modules 213, 223, and input/output interfaces 214, 224. The memories 211 and 221 are computer-readable recording media and include RAM (random access memory), ROM (read only memory), and permanent mass storage devices such as disk drives. OK. Here, a permanent mass storage device such as a ROM and a disk drive may be included in the electronic device 1 (110) or the server 150 as a separate permanent storage device separate from the memories 211,221. The memories 211 and 221 also store an operating system and at least one program code (for example, a browser installed and driven in the electrical device 1 (110) and a browser installed in the electronic device 1 (110) to provide a specific service). code for installed applications, etc.) may be stored. Such software components may be loaded from a computer-readable recording medium separate from the memories 211,221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD/CD-ROM drive, memory card, and the like. In other embodiments, the software components may be loaded into memory 211, 221 through communication modules 213, 223 that are not computer readable media. For example, at least one program is a computer program (as an example, the above-mentioned may be loaded into the memory 211, 221 based on the application).

Processors 212, 222 may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to processors 212 , 222 by memory 211 , 221 or communication modules 213 , 223 . For example, processors 212 , 222 may be configured to execute received instructions according to program code stored in a storage device, such as memory 211 , 221 .

Communication modules 213 and 223 may provide functions for electronic device 1 (110) and server 150 to communicate with each other via network 170, and electronic device 1 (110) and/or server 150 may communicate with each other. may provide functionality for communicating with other electronic devices (eg, electronic device 2 (120)) or other servers (eg, server 160). As an example, a request generated by the processor 212 of the electronic device 1 (110) according to program code stored in a recording device such as the memory 211 is transmitted to the server 150 via the network 170 under the control of the communication module 213. you can Conversely, control signals, commands, contents, files, etc., provided under the control of the processor 222 of the server 150 are transmitted to the electronic device via the communication module 213 of the electronic device 1 (110) via the communication module 223 and the network 170. 1 (110). For example, control signals, instructions, content, files, etc. of the server 150 received through the communication module 213 may be transmitted to the processor 212 and the memory 211, and the content, files, etc. may be further included in the electronic device 1 (110). may be stored in any storage medium (permanent storage as described above).

Input/output interface 214 may be a means for interfacing with input/output devices 215 . For example, input devices may include devices such as keyboards or mice, and output devices may include devices such as displays and speakers. As another example, input/output interface 214 may be a means for interfacing with a device that integrates functionality for input and output, such as a touch screen. The input/output device 215 may consist of one device with electronic device 1 (110). Input/output interface 224 of server 150 may also be a means for interfacing with devices (not shown) for input or output that are coupled to server 150 or that server 150 may include. As a more specific example, when the processor 212 of the electronic device 1 (110) processes the instructions of the computer program loaded into the memory 211, data provided by the server 150 and the electronic device 2 (120) are used. The service screens and content displayed may be displayed on the display through the input/output interface 214 .

Also, in other embodiments, electronic device 1 (110) and server 150 may include more components than those in FIG. However, most prior art components need not be explicitly shown in the figures. For example, electronic device 1 (110) may be implemented to include at least some of the input/output devices 215 described above, a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database It may further include other components such as As a more specific example, when the electronic device 1 (110) is a smartphone, the acceleration sensor, gyro sensor, camera module, various physical buttons, buttons using a touch panel, input/ Various components such as an output port, a vibrator for vibration, etc. may be implemented to be further included in the electronic device 1 (110).

FIG. 3 is a diagram illustrating an example of a cloud artificial intelligence platform in one embodiment of the present invention. FIG. 3 shows electronic device 310 and cloud artificial intelligence platform 320 and content service 330 .

As an example, the electronic device 310 may include at least a plurality of the electronic devices 110, 120, 130, and 140 described above. , may interface with cloud artificial intelligence platform 320 via interface connect 340 . As an example, cloud artificial intelligence platform 320 may include at least server 150 as described above. Here, the interface connect 340 may provide developers with an SDK (Software Development Kit) and/or development documents for developing the electronic device 310 and applications installed and driven on the electronic device 310 . The interface connect 340 may also provide an API (Application Program Interface) that allows the electronic device 310 or an application installed and driven on the electronic device 310 to utilize the functions provided by the cloud artificial intelligence platform 320 . As a specific example, a device or application developed by a developer using an SDK (Software Development Kit) and/or a development document provided by the interface connect 340 can use the API provided by the interface connect 340 to: It becomes possible to utilize the functions provided by the cloud artificial intelligence platform 320 .

As an example, the cloud artificial intelligence platform 320 may provide functionality for providing voice-based services. For example, the cloud artificial intelligence platform 320 includes an audio processing module 321 for recognizing received audio and synthesizing output audio for the recognized audio, and a vision module 321 for analyzing and processing received video and video. A processing module 322, a conversation processing module 323 for determining suitable conversations for outputting appropriate speech according to the received speech, a recommendation module 324 for recommending functions suitable for the received speech, and artificial intelligence data learning. It may include various modules for providing speech-based services, such as a neural machine translation (NMT) 325 that supports language translation on a sentence-by-sentence basis.

For example, consider the situation where the user of electronic device 2 (120) utilizes electronic device 2 (120) to communicate a voice call request to electronic device 1 (110). At this time, it is assumed that the electronic device 1 (110) recognizes a situation in which the user of the electronic device 1 (110) cannot directly accept the voice call request under the control of the application. In this case, the electronic device 1 (110) automatically accepts the voice call request from the electronic device 2 (120) even if the user does not directly control the electronic device 1 (110) and the electronic device 1 (110). 2 (120), a voice call session is set up. In addition, the electronic device 1 (110) uses the functions provided by the cloud artificial intelligence platform 320 via the interface connect 340 under the control of the application, thereby using the user of the electronic device 2 (120) and artificial intelligence. You may carry out a conversation with In this case, the artificial intelligence may recognize the voice of the user of the electronic device 2 (120) transmitted through the voice call session described above by the voice processing module 321, and generate a conversation suitable for the recognized voice by the conversation processing module 323. may be determined by In addition, the artificial intelligence may synthesize an output voice to be output according to the determined conversation using the voice processing module 321 again, and the synthesized output voice is transmitted through the above-described voice call session to the electronic device 2. (120), a voice call is established between the artificial intelligence and the user of the electronic device 2 (120).

In addition, the expansion kit 350 may provide a development kit that enables third-party content developers or companies to implement new voice-based functions based on the cloud artificial intelligence platform 320 . For example, assume that an application installed in electronic device 1 (110) is third-party content developed using the above-described development kit. In this case, third-party content developers do not need to independently develop artificial intelligence for automatically executing voice calls, but their applications communicate with cloud artificial intelligence platform 320 via interface connect 340. , by utilizing the functions included in the cloud artificial intelligence platform 320, it is possible to provide a conversation function using artificial intelligence.

In the embodiment of FIG. 3, the functions for processing voice conversations among the functions for artificial intelligence are provided to modules (voice processing module 321 and conversation processing module 323) included in cloud artificial intelligence platform 320. explained. However, in some embodiments, all functionality for artificial intelligence may be included in an application installed and driven on electronic device 1 (110). In this case, the electronic device 1 (110) no longer needs to communicate with the server 150 such as the cloud artificial intelligence platform 320, and the conversation with the user of the electronic device 2 (120) is performed by the voice processing module 321 and the conversation processing module 323. It becomes possible to execute it voluntarily.

FIG. 4 is a diagram showing an example of the overall process for contact control of an electronic device in one embodiment of the present invention.

The first process 410 may be a process in which the electronic device 1 (110) receives a contact request from the electronic device 2 (120). Here, the contact requests setting and maintenance of a communication session between the electronic device 1 (110) and the electronic device 2 (120) such as voice call, video call, or instant message transmission/reception using messenger. may include contacts to be received, and electronic device 1 (110) and electronic device 2 (120), such as receiving SMS (Short Message Service), MMS (Multimedia Message Service), e-mail (e-mail), etc. may include contacts for which no communication session is required to be maintained during the In addition, although FIG. 4 shows that the contact request is directly transmitted from the electronic device 2 (120) to the electronic device 1 (110), in reality, depending on the type of contact, may be transmitted to the electronic device 1 (110) via various intermediate nodes of. For example, an instant message using messenger may be sent to the electronic device 1 (110) via a messenger server, and a call signal for a voice call may be received via a server that processes call signals for voice calls. It may be sent to electronic device 1 (110). Similarly, call signals for a video call may be sent to electronic device 1 (110) via a server that processes the video call.

The second step 420 may be a step of determining whether the electronic device 1 (110) is directly controllable by the user of the electronic device 1 (110). Here, the user's situation includes a situation in which the user can directly control the contact request (hereinafter referred to as "first situation") and a situation in which the user cannot directly control the contact request (hereinafter referred to as "second situation"). 2 situations"). At this time, the user's situation may be determined by analyzing information acquired in relation to the user, such as the user's schedule and lifestyle. Such information may be information stored and managed in advance in the electronic device 1 (110), but a server (for example, , server 150) may be received from outside the electronic device 1 (110). Such a second step 420 may be performed prior to providing the user with notification upon receipt of the contact request. For example, in the prior art, a notification such as a bell sound or vibration is output in response to receiving a call signal for a voice call, and the user processes the contact request in response to the output of such notification. On the other hand, the electronic device 1 (110) according to the present embodiment may first determine the user's status as if the user's direct control is possible before outputting the notification upon receipt of the contact request. .

The third step 430 may be a step of outputting a notification of receipt of the contact request by the electronic device 1 (110) in the first situation. In this case, the user of electronic device 1 (110) may directly process the contact request in response to the output notification.

A fourth process 440 may be a process in which the electronic device 1 (110) processes the contact under direct control of the user, and then the process for contact control ends. For example, when the requested contact is a voice call or a video call, after the voice call or video call is made between the user of the electronic device 1 (110) and the user of the electronic device 2 (120), the second 1 At step 410, the contact request associated with the received contact request may be terminated. Alternatively, if the requested contact is an instant message, after the user of the electronic device 1 (110) confirms the received instant message, the contact control associated with the received contact request in the first step 410 ends. You can

The fifth process 450 may be a process in which the electronic device 1 (110) uses artificial intelligence to accept the contact request and take action in the second situation. For example, in the case of a voice call or video call, after the artificial intelligence directly accepts the contact request, the voice call or video call may be made between the user of the electronic device 2 (120) and the artificial intelligence. In this case, there is no need to output audio and video transmitted and received between the user of the electronic device 2 (120) and the artificial intelligence to the electronic device 1 (110). Calls and video calls may be made. As another example, when an instant message is received, the artificial intelligence may send a reply message to the received instant message to electronic device 2 (120).

A sixth process 460 may be a process in which the electronic device 1 (110) generates a summary related to the AI response. The abstract includes the type of contact (for example, voice call, video call, instant message, etc.), the time the contact request was received, the artificial intelligence by the artificial intelligence response, and the user of the electronic device 2 (120). information such as the content of the conversation, or summary information for such conversation content. For example, when an artificial intelligence responds to a voice call, the artificial intelligence recognizes the speech included in the content of the conversation with the user of the electronic device 2 (120), and converts the recognized speech into text. you can After this, the converted text may be analyzed to generate summary information.

A seventh process 470 may be a process of monitoring whether the electronic device 1 (110) is directly controllable by the user of the electronic device 1 (110). In this case as well, electronic device 1 (110) analyzes information learned in relation to the user of electronic device 1 (110), such as the schedule and lifestyle of the user of electronic device 1 (110). Depending on the contact request, the user of the electronic device 1 (110) can directly control the first state, or the contact request cannot be directly controlled by the user of the electronic device 1 (110). 2 may determine if there is a situation.

For example, according to the schedule of the user of the electronic device 1 (110), the meeting is scheduled from 14:00 to 16:00 today, and the contact request described in the first process 410 is received at 15:00 today. Suppose In this case, the artificial intelligence may determine that the user of the electronic device 1 (110) is in a second situation where the user of the electronic device 1 (110) cannot directly control the received contact request, and as described in the fifth step 450, the contact may accept the request and process the response directly. The artificial intelligence may then generate a summary sentence associated with the response. Assume that the summary is generated at 15:30 at this time. Since the meeting is scheduled to end at 16:00, the artificial intelligence may determine that the electronic device 1 (110) is in a second situation in which direct control by the user of the electronic device 1 (110) is impossible until 16:00, You may delay the summary report until 16:00.

The eighth step 480 is that the electronic device 1 (110) changes the status of the user of the electronic device 1 (110) from the second status to the first status, and the electronic device 1 (110) sends It may be the process of reporting to the user. For example, the electronic device 1 (110) provides a notification to the user to notify that there is a contact, and displays the generated summary on the screen of the electronic device 1 (110) according to the user's reaction to the notification. You can

On the other hand, in some embodiments, summary sentences may be reported in the second context. For example, the artificial intelligence can generate a summary even in the second situation if an input by the user of the electronic device 1 (110) occurs after generation of the summary, or if a condition preset by the user is met. Sentences may be reported. For example, even if the user is in the middle of a meeting, it may be determined that the user has some time to spare when an input occurs in the electronic device 1 (110). In this case, a summary sentence may be reported even in the second situation in response to the occurrence of user input. In effect, a notification may be provided to the user regarding the report of the summary text, and the user may choose to review the reported summary immediately or lazily as the case may be. As another example, even if the user cannot pick up the phone directly, the summary may be confirmed. In such a case, if the conditions preset by the user (for example, the importance of the contact, a specific time or a specific place, etc.) are met, the summary is reported even in the second situation. good.

In another embodiment, even when the user directly processes the contact request in the above-described fourth step 440, the summary may be generated and provided according to the user's request. For example, it is assumed that the reception of a voice call rings a bell and the user operates the electronic device 1 (110) to start a voice call. At this time, upon input of a request from the user, the artificial intelligence may record and summarize the contents of the voice call between the user and the caller and provide a summary sentence. In this case, the user can reconfirm the main points of the conversation with the caller by summarizing them even after the call ends. At this time, the request from the user may be input as a preset voice (for example, "Sally (an example of an identifier of artificial intelligence), now record/summarize the contents of the call"), or the screen may be input by a preset user interface button (eg, "AI call request") displayed in the . As a more specific example, electronic device 1 (110) outputs a preset voice (for example, "Sally" described above) under the control of an application while the user is in direct contact with the caller. Upon recognition, it may act to process the resulting request or display a user interface on the screen for triggering call recording and/or summaries. In addition, the electronic device 1 (110) may record and/or summarize the contents of the contact between the user and the caller according to the user's input request, and report the recorded contents and summary sentences to the user. On the other hand, when the consent of the caller is required for recording the contents of the call, the electronic device 1 (110) synthesizes voice for obtaining the consent of the caller, seeks the consent of the caller, and Recording may be initiated in response. At this time, the process of asking the caller for consent and the caller's response may be further recorded. In this way, even when the user contacts the caller directly, the content of the contact may be recorded and/or summarized and provided to the user, not in the case of automatic response using artificial intelligence. Video calls may also provide such recording and/or summarization capabilities. In this case, at least some of the video may be recorded together and included in the summary.

In the embodiment of FIG. 4, an example has been described in which the electronic device 1 (110) directly processes contact control using artificial intelligence in response to a contact request from the electronic device 2 (120). On the other hand, in another embodiment, a server linking contacts between electronic device 1 (110) and electronic device 2 (120) processes such contact control.

FIG. 5 is a diagram showing an example of the overall process for server contact control in one embodiment of the present invention. Server 150 may be a computing device of a system that provides services for a particular contact between electronic device 1 (110) and electronic device 2 (120). In this case, the contact request of the electronic device 2 (120) may be transmitted to the electronic device 1 (110) through the server 150. FIG.

In a first step 510, the server 150 may receive a contact request for electronic device 1 (110) from electronic device 2 (120). For example, server 150 may be a computing device of a system that provides messaging services, voice call services, and/or video call services through messenger. When the user of the electronic device 2 (120) selects the account or phone number of the user of the electronic device 1 (110) and requests voice call, video call, or instant message transmission, the contact request is sent through the server 150. It may be transmitted to the electronic device 1 (110). A first process 510 may mean a process in which the server 150 receives such a contact request.

A second step 520 may be a step in which the server 150 determines whether the user's direct control of the electronic device 1 (110) is possible. For example, the server 150 responds to the contact request by analyzing information acquired in relation to the user of the electronic device 1 (110), such as the schedule and lifestyle of the user of the electronic device 1 (110). , a first situation in which direct control of the user of electronic device 1 (110) is possible, or a second situation in which direct control of the user of electronic device 1 (110) in response to the contact request is not possible. You can At this time, the information such as schedule and lifestyle may be information uploaded by the user of electronic device 1 (110) and directly managed by server 150, or may be information provided from a schedule management server or the like. There may be.

A third process 530 may be a process in which the server 150 transmits a contact request to the electronic device 1 (110) in the first situation. In this case, the electronic device 1 (110) may output a notification such as a bell sound or vibration in response to the received contact request.

A fourth step 540 may be a step of terminating the contact control process after the electronic device 1 (110) processes the contact. For example, the electronic device 1 (110) may perform contact processing such as making a voice call or a video call according to the user's control in response to the contact request, or displaying the received instant message on the screen. After this, the process of contact control may end. At this time, even if the user directly processes the contact with the caller, as described above, the artificial intelligence triggered by the input of the request from the user records and/or summarizes the voice call or video call. and may provide a condensed summary to the user.

A fifth process 550 may be a process in which the server 150 processes contact with the electronic device 2 (120) through artificial intelligence response in the second situation. As described above, in the case of a voice call or video call, after the artificial intelligence directly accepts the contact request, the voice call or video call is made between the user of the electronic device 2 (120) and the artificial intelligence. good. As another example, when an instant message is received, the artificial intelligence may send a reply message to the received instant message to electronic device 2 (120).

A sixth process 560 may be a process of generating a summary for the artificial intelligence response after completing the artificial intelligence response. As described above, the summary includes the type of contact (eg, voice call, video call, instant message, etc.), the time the contact request was received, the artificial intelligence from the artificial intelligence response and the electronic device 2 (120). information such as conversations between users, or summary information for such conversations.

A seventh process 570 may be a process in which the server 150 monitors whether the user's direct control of the electronic device 1 (110) is possible. Also in this case, the server 150 analyzes the information learned in relation to the user of the electronic device 1 (110), such as the schedule and lifestyle of the user of the electronic device 1 (110), to determine the number of contacts. A first situation in which the user of the electronic device 1 (110) can directly control the request, or a second situation in which the user of the electronic device 1 (110) cannot directly control the contact request. You may decide whether

An eighth step 580 is a process in which the server 150 reports to the electronic device 1 (110) the summary generated by changing the status of the user of the electronic device 1 (110) from the second status to the first status. can be The reported summary may be displayed through electronic device 1 (110) and provided to the user of electronic device 1 (110).

Alternatively, embodiments in which the embodiment of FIG. 4 and the embodiment of FIG. 5 are combined may be considered. For example, the first step 410 and the second step 420 of FIG. 4 are performed by the electronic device 1 (110), and when the contact request is not directly controlled by the user in the first situation, the server sends the contact request to the server. 150 may cause server 150 to handle artificial intelligence interactions with electronic device 2 (120). In this case, the server 150 may process the fifth process 550 and the sixth process 560 of FIG. 5 to process the artificial intelligence response and the generation of the abstract. The generated summary may be communicated to electronic device 1 (110) and reported to the user via steps 7 470 and 480 of FIG.

In this way, when receiving a voice or video call or receiving a message by synchronizing the user's (called party's) schedule or analyzing the user's lifestyle, the user's situation can be determined. If it is judged that it is difficult for the user to respond directly, AI is used to automatically process the conversation with the caller, and then summarize the response and report it to the user. As a result, contact control can be made possible by artificial intelligence even for contact requests that are difficult for users to respond to directly.

6 and 7 are diagrams showing an example of providing a summary sentence in one embodiment of the present invention.

FIG. 6 is an example of a screen of electronic device 1 (110) displaying a summary of responses to a voice call, in which the summary is displayed in the form of a pop-up window 610 on the screen of electronic device 1 (110). is shown. In such a pop-up window 610, information for indicating what type of contact (voice call) was made from who (Ms. Alice), the date and time when the contact request was received, and the artificial intelligence's response to the contact The time of the response (duration of the call) and summary information on the content of the response (summary of the content of the response) are shown. In addition, the pop-up window 610 shows an example in which a 'call now button 620' is provided as a user interface for immediately connecting a call with a contact partner (Ms. Alice). If the user selects the call now button 620 (eg, the user touches the area where the call now button 620 is displayed in a touchscreen environment), a voice call with the contact (Ms. Alice) may be attempted. .

FIG. 7 shows an example of a screen of the electronic device 1 (110) displaying a summary of message reception, in which the summary is displayed in the form of a pop-up window 710 on the screen of the electronic device 1 (110). ing. In such a pop-up window 710, information for indicating from whom (Mr. Ted) what kind of contact (message reception using messenger A) was made, and the date and time when the contact request (message) was received. , and summary information (a summary of the content of the response) regarding the content of the response. In addition, the pop-up window 710 shows an example in which a 'move to chat room' button 720 is provided as a user interface for calling the chat room of messenger A who has sent and received messages with the contact partner (Mr. Ted). . When the user selects the move to chat room button 720, messenger A may display a chat room with the contact partner (Mr. Ted) on the screen of electronic device 1 (110).

On the other hand, the identification information for identifying the contact partner such as Alice in FIG. 6 or Ted in FIG. ) may be the caller's name retrieved by phone number from the friend list of the ), or the display name of the retrieved account. Also, the gender (Ms. or Mr.) of the contact person may be determined by analyzing the gender probability value of the name and/or the caller's voice. For example, for each name, such as the identified name "Alice," empirically accumulated data of probability values that the gender of the subject is male or female may be utilized. The sex of the contact may also be determined by the artificial intelligence analyzing the tone of voice of the contact during the service. Also, both probability values and voice may be used to determine the gender of a contact. Furthermore, the display of gender may be omitted for the display name of an account instead of a person's name.

When it is difficult to obtain identification information for specifying the contact partner from an address book, a messenger account, etc., the artificial intelligence uses the name of the contact partner and the user of the electronic device 1 (110) in the process of responding. You can directly ask about the relationship. For example, the artificial intelligence may obtain information about the contact person by asking a question such as "Who would you like to be contacted by?", and may utilize the obtained information to generate a summary sentence.

Also, in a voice call or a video call, the gender, tone, etc. of the response voice of the artificial intelligence may be changed according to the gender, age, etc. of the caller ascertained. For example, the artificial intelligence may respond with a female voice to male callers and vice versa. As another example, a child caller may be addressed by the voice of a particular character (eg, an animated character popular with children).

Also, although the embodiments of FIGS. 6 and 7 describe an example of reporting a summary using pop-up windows 610 and 710, the summary may be reported to the user in a variety of ways. For example, a summary may be displayed on the execution screen of an application that provides a service for contact control, or a summary may be output in a form in which artificial intelligence synthesizes the content of the summary as speech and then outputs the synthesized speech. may be reported. In this case, artificial intelligence may report summaries in a conversational form with the user. For example, in connection with the embodiment of FIG. 6, while the artificial intelligence is outputting synthesized speech "I received a voice call from Ms. Alice", the user utters "Call Alice." ' recognizes the voice command, the artificial intelligence does not need to report the entire summary sentence and may immediately conduct a voice call with Alice.

Further, in the above-described embodiment, an example has been described in which the artificial intelligence directly responds to the contact through contact control in response to the contact request and reports the result to the user.

In addition to this, artificial intelligence can also perform various post-processing such as automatically setting a new schedule or automatically setting an alarm time based on the information obtained by responding to the contact partner. is.

FIG. 8 is a diagram showing an example of reporting post-processing content in one embodiment of the present invention.

FIG. 8 is an example of a screen of electronic device 1 (110) displaying a summary of responses to a voice call, in which the summary is displayed in the form of a pop-up window 810 on the screen of electronic device 1 (110). is shown. Such a pop-up window 810 includes information for indicating what type of contact (voice call) was made from whom (Ms. Carol), the date and time when the contact request was received, and when the artificial intelligence responded to the contact. Time (duration of call), summary information on the content of the response (summary of response content), and post-processing content (schedule addition) are shown. For example, the artificial intelligence may analyze the content of the reception, recognize the schedule for the "Saturday at 3:00 pm" appointment, and retrieve the recognized schedule from the registered schedules. If no schedule is registered for that date and time, the artificial intelligence may add that schedule. Also, FIG. 8 shows an example of a schedule confirmation button 830 included as a user interface for activating the schedule application in the pop-up window 810 and confirming additional schedules. If the user selects the confirm schedule button 830, the schedule application may be executed and information regarding the additional schedule may be displayed to the user. In some embodiments, a contact may set an appointment in conversation with the artificial intelligence. For example, the artificial intelligence may recognize the request that the contact wants to make an appointment with the user at 7:00 this evening, add to the schedule, and then report such post-processing and response details to the user.

The artificial intelligence may also maintain a conversation with the contact person until the point at which the user has direct control over the contact. For example, it may be considered that the user is in a meeting or exercising and the meeting or exercise is expected to end within a preset time (one minute, for example). In this case, the artificial intelligence informs the contact that the user will be available to pick up the phone within a certain amount of time, and that waiting time is used to close the contact by inducing a conversation with the contact. may be maintained. In other words, the artificial intelligence may optionally maintain contact until the user can directly participate in the contact.

In yet another embodiment, the artificial intelligence may interrupt the artificial intelligence response depending on the urgency of the contact and provide a notification for the user to join the contact. As an example, the artificial intelligence may measure the importance to the user's current situation, and the artificial intelligence response may measure and compare the importance of the contact respectively. At this time, the artificial intelligence may determine the purpose of the contact based on the conversation with the contact partner, and determine the importance of the contact according to the determined purpose. Artificial intelligence may also determine the importance of a situation according to the type of user's situation (for example, during a meeting, while exercising, etc.). At this time, if the importance of the contact is higher than the importance of the situation, the artificial intelligence may interrupt the artificial intelligence response and provide a notification to engage the user in the contact. In this case, the artificial intelligence may display information on the screen or output a synthesized voice to indicate that the requested contact is for a very important purpose.

Further, in other embodiments, a user may directly select whether to have an artificial intelligence response performed on a contact.

FIG. 9 is a diagram illustrating an example of a user interface for selecting acceptance or rejection of voice calls in one embodiment of the present invention. FIG. 9 shows a first screen 910 and a second screen 920 of the electronic device 1 (110) when a voice call is received. A first screen 910 shows an accept button 911 for accepting an incoming voice call and a reject button 912 for rejecting an incoming voice call. If the user selects the reject button 912 , the first screen 910 may change to a second screen 920 . A second screen 920 shows that an AI call button 921, a message button 922, and a snooze button 923 are added in addition to the accept button 911 and reject button 912 whose sizes and shapes are changed.

At this time, the AI call button 921 may be a user interface for responding to artificial intelligence. For example, if the user selects the AI call button 921, an artificial intelligence response as described above may be performed. In other words, the artificial intelligence may converse with the originator of the voice call and generate a summary to provide to the user.

Also, the message button 922 may be a user interface for transmitting a preset rejection message. For example, if the user selects the message button 922, a preset rejection message may be communicated to the originator of the voice call. As another example, if the user selects the messages button 922, the user may be provided with a user interface for selecting one of multiple rejection messages. In this case, when the user selects one of the multiple rejection messages, the selected rejection message may be communicated to the originator of the voice call.

Additionally, snooze button 923 may be a user interface for requesting the caller to leave a voice note. For example, if the user selects the snooze button 923, a request may be provided to the caller to leave a voice note. When the caller leaves a voice memo, the voice memo may be stored in the electronic device 1 (110), and a notification to listen to the voice memo after a preset time (for example, 3 minutes) or a voice memo. Recognized and converted text information may be provided to the user in the form of a pop-up window or the like.

Such various rejection options can help the caller to grasp the caller's intention of contacting in various ways even when it is difficult for the user to pick up the phone, thereby increasing the call connection rate. . Also, a user interface for selecting acceptance or rejection of video calls as well as voice calls may be implemented in the same manner as in the embodiment of FIG.

In yet another embodiment, the artificial intelligence is associated with receiving a video call and considers the relationship between the user and the caller, the user's preferences, and/or the user's preferences to provide a preview screen for receiving the video call. may be determined. For example, if the caller wants to be liked by the user (for example, a friend of the opposite sex), if the user has a tendency to emphasize appearance, or if the caller is a person set by the user, the video call The preview screen may display a selfie video. In other words, before accepting the video call, the user may be given time to pre-check and refine his or her appearance with the selfie video displayed on the preview screen. On the other hand, if the caller has a close relationship with the user, or if the user has a tendency to desire quick acceptance and quick execution of a video call rather than adjusting the appearance, the caller is set by the user. If the person is not a person, the self-portrait image may not be displayed on the preview screen of the video call. As such, the artificial intelligence can automatically turn on/off the function for displaying the self-portrait image on the preview screen of the video call according to various conditions.

FIG. 10 is a diagram showing an example of a preview screen displaying a self-portrait image in one embodiment of the present invention. FIG. 10 shows an example of a preview screen 1010 on which the user of the electronic device 1 (110) can select acceptance or rejection of the video call upon receiving a video call request from the caller "Ted". there is At this time, electronic device 1 (110) displays the self-portrait image on preview screen 1010 based on the above-described various conditions (the relationship between the user and the caller, the user's tendency, and/or the user's settings). may be determined. In FIG. 10, a real-time video stream 1030 is being captured by a front camera (or selfie camera) 1020 included in electronic device 1 (110) due to electronic device 1 (110) deciding to display a selfie video. is displayed on the preview screen 1010 .

FIG. 11 is a flowchart illustrating an example contact control method in one embodiment of the present invention. The contact control method according to this embodiment may be executed by a computer device such as the electronic device 1 (110) described above. At this time, the processor 212 of the electronic device 1 (110) may be implemented to execute control instructions by the code of the operating system and the code of at least one program contained in the memory 211 . Here, processor 212 causes electronic device 1 (110) to perform steps 1110 to 1150 included in the contact control method shown in FIG. 11 according to control instructions provided by codes stored in electronic device 1 (110). Also, the electronic device 1 (110) may be controlled.

At step 1110, electronic device 1 (110) may receive a contact request from a caller over the network. Contacts may mean voice or video calls, or sending and receiving messages, as described above. At this time, the contact request may include a call signal in the case of a voice call or a video call, and may include a message sent by the caller in the case of message transmission/reception. Such a contact request may be sent directly from the caller over the network, but typically may be communicated through a server that provides a voice or video call service or messaging service. In this case, the user of electronic device 1 (110) may be the recipient of the contact.

At step 1120, electronic device 1 (110) may determine if direct control of the callee to the contact request is enabled. For example, the electronic device 1 (110) may contact at least one of the callee's schedule information registered for the callee, the lifestyle information pre-analyzed for the callee, and the callee's input. The time the request was received may be used to determine if direct control of the callee is possible. At this time, the schedule information may include schedule information registered in the electronic device 1 (110) and/or information registered online and synchronized with the electronic device 1 (110). On the other hand, the lifestyle information may include information about the callee's expected situation at the current time based on information obtained by continuously analyzing the callee's daily routine. For example, for a callee who jogs between 6:00 and 7:00 every morning, the status between 6:00 and 7:00 am may be determined to be "exercising." Alternatively, the status of the called party may be subdivided based on the time the called party is at work, the time at home, or the like. The callee's input correlates with the time the contact request is received and may be utilized to determine if the callee is operating electronic device 1 (110). For example, if the called party is continuously operating the electronic device 1 (110), it may be determined that the called party can directly process the contact request.

At steps 1130 and 1140, electronic device 1 (110) may output a notification for the contact request if the callee's direct control over the contact request is available. In this case, the user may directly process the contact request in response to the output notification.

In steps 1130 and 1150, electronic device 1 (110) uses artificial intelligence to converse with the caller of the contact when direct control of the called party is impossible for the contact request, and the contact is made. can be processed. If it is determined that the callee is in a difficult situation to handle the contact request directly, artificial intelligence may be used to handle the contact directly without providing notification to the callee.

On the other hand, the electronic device 1 (110) may generate summary information of the conversation and report it to the called party under the control of the application. For example, electronic device 1 (110) may generate summary information about the conversation conducted in step 1150, and provide the generated summary information to the called party if direct control of the called party is enabled. You can Here, the summary information may include summary information regarding the contact type, the time the contact request was received, and the content of the conversation.

Further, electronic device 1 (110) may perform post-processing depending on the result of the conversation. For example, in FIG. 8, an example of post-processing for adding a schedule has been described. For this purpose, the electronic device 1 (110) extracts information relating to at least one of the date, time, and location included in the content of the conversation, and extracts at least one information relating to the contact originator. Information may be associated to register schedules or alarms.

Also, the electronic device 1 (110) may directly process the user's contact request in various ways, as described with reference to FIG. For example, electronic device 1 (110) may further provide a user interface for accepting or rejecting the contact request if direct control of the called party is possible. Such a user interface may be provided with the notification described in step 1140. At this time, the user interface includes a user interface for accepting the request for contact and a user interface for rejecting the request for contact, a user interface for executing a conversation with the caller by artificial intelligence, and a user interface for the caller. It may further include at least two or more of a user interface for requesting to leave a voice memo and a user interface for sending a rejection message to the caller.

In addition, as described with reference to FIG. 10, the electronic device 1 (110), when the contact is a video call and can be directly controlled by the called party, the relationship between the called party and the calling party, the incoming call It is determined whether to display a self-portrait image according to at least one of the tendency of the person and the setting of the called party. ) and display the real-time video stream captured by the selfie camera on the preview screen of the video call, providing time for the callee to check and adjust their appearance according to the conditions. good.

FIG. 12 is a flowchart illustrating an example of using artificial intelligence to process contacts in one embodiment of the invention. Steps 1210-1250 of FIG. 12 may be performed when the contact is a voice call or a video call, are included in step 1150 described with reference to FIG. 11, and may be performed by electronic device 1 (110).

At step 1210, the electronic device 1 (110) may receive the contact caller's voice through a voice call session or a video call session established by accepting the contact request.

At step 1220, the electronic device 1 (110) may recognize the received speech by a speech processing module comprising artificial intelligence. For example, artificial intelligence may be implemented by an application installed and driven on electronic device 1 (110). Such applications may include speech processing modules for speech recognition and synthesis, and electronic device 1 (110) recognizes speech received by such speech processing modules under the control of the application. good. As described with reference to the embodiment of FIG. 3 above, artificial intelligence may be implemented by cloud artificial intelligence platform 320 . In this case, the electronic device 1 (110) may transmit received audio to the cloud artificial intelligence platform 320 via the interface connect 340, and the audio received by the audio processing module 321 included in the cloud artificial intelligence platform 320 is may be recognized.

At step 1230, the electronic device 1 (110) may analyze the recognized speech by the speech processing module included in the artificial intelligence to generate a reply speech. Also in this case, the electronic device 1 (110) may generate a reply conversation using the conversation processing module implemented by the application, or use the conversation processing module 323 included in the cloud artificial intelligence platform 320. A reply conversation may be generated.

At step 1240, the electronic device 1 (110) may generate output audio corresponding to the reply speech generated by the audio processing module. In this case as well, the electronic device 1 (110) may synthesize the output speech using a speech processing module realized by the application, or use the speech processing module 321 included in the cloud artificial intelligence platform 320. The output speech may be synthesized.

At step 1250, electronic device 1 (110) may transmit the generated output audio to the caller of the contact through the established voice call session or video call session. In this case, the caller of the contact can hear the artificial intelligence response voice corresponding to the caller's voice through the requested contact (voice call or video call).

When utilizing an external artificial intelligence server such as the cloud artificial intelligence platform 320, the electronic device 1 (110) transmits the voice or message received from the caller of the contact to the artificial intelligence server via the network, A reply voice or reply message corresponding to the voice or message may be received from the intelligent server, and the received reply voice or reply message may be sent to the caller of the contact.

Such steps 1210 to 1250 may mean one conversation process in which the artificial intelligence responds to the caller's utterance. However, if necessary, a person skilled in the art will understand that the artificial intelligence may first synthesize the output voice and send it to the caller, or a number of conversations may be conducted between the artificial intelligence and the caller. can be easily understood.

As another embodiment, when the contact includes message transmission/reception, the electronic device 1 (110) does not require the process of speech recognition or speech synthesis. A message received from may be analyzed to generate a response conversation, and a message including the generated response conversation may be sent to the contact originator. Here, the artificial intelligence conversation processing module may be realized by the application of the electronic device 1 (110) as described above, or may correspond to the conversation processing module 323 included in the cloud artificial intelligence platform 320.

In yet another embodiment, artificial intelligence-assisted contact processing may be performed by the server that provides the service for the contact. For example, the server may be a system that provides services (eg, voice call service, video call service, or messaging service) for contact between a called party and a caller. At this time, the electronic device 1 (110) may request the server providing the contact service to process the conversation using artificial intelligence in step 1150 described with reference to FIG. In this case, the server may be implemented to use artificial intelligence to converse with the caller of the contact, process the contact, and generate and send summary information of the conversation at the request of the called party. . For example, the server may correspond to server 150 described with reference to FIG. In this case, electronic device 1 110 may receive conversation summary information from the server at step 1150 . The summary information may correspond to the summary sentences described with reference to FIGS. 6-8, and when the situation arises that the called party, the user of electronic device 1 (110), can directly control the contact, May be reported to the called party.

FIG. 13 is a flowchart illustrating an example of a server contact control method in one embodiment of the present invention. The contact control method according to this embodiment may be executed by a computer device such as the server 150 described above. At this time, the processor 222 of the server 150 may be implemented to execute control instructions by the operating system code and at least one program code contained in the memory 221 . Here, processor 222 may control server 150 such that server 150 performs steps 1310-1360 included in the contact control method of FIG. 13 according to control instructions provided by code stored on server 150. .

At step 1310, the server 150 may receive a contact request for the called party from the caller over the network. Contacts may mean voice or video calls, or sending and receiving messages, as described above. At this time, the contact request may include a call signal in the case of a voice call or a video call, and may include a message sent by the caller in the case of message transmission/reception. Server 150 may receive the contact request to be delivered to the called party and may perform step 1320 before delivering the contact request to the called party. Here, the called party may correspond to the user of the electronic device 1 (110) described above.

At step 1320, server 150 may determine whether the callee's direct control over the contact request is enabled. For example, the server 150 receives the contact request and at least one of the callee's schedule information registered for the callee, the lifestyle information pre-analyzed for the callee, and the callee's input. The time of day may be used to determine if direct control of the called party is possible. At this time, the schedule information is information in which the server 150 synchronizes and manages the schedule information of the called party registered in the electronic device 1 (110) and/or the schedule information of the called party registered online. good. On the other hand, the lifestyle information may include information about the callee's expected situation at the current time based on information obtained by continuously analyzing the callee's daily routine. For example, for a callee who jogs between 6:00 and 7:00 every morning, the status between 6:00 and 7:00 am may be determined to be "exercising." Also, the status of the called party may be subdivided based on the time the called party is at work, the time at home, or the like. Such lifestyle information may be generated and managed by server 150 based on various information received by server 150 from electronic device 1 (110).

At steps 1330 and 1340, server 150 may communicate the contact request to the called party. In this case, the called party, who is the user of electronic device 1 (110), may directly process the contact request in response to the notification output by electronic device 1 (110) according to the transmitted contact request. .

At steps 1330 and 1350, server 150 may use artificial intelligence to converse with the contact originator to process the contact if direct control of the callee to the contact request is not possible. If it is determined that it is difficult for the called party to directly process the contact request, the server 150 does not transmit the contact request to the called party and directly processes the contact using artificial intelligence. good.

At step 1360, server 150 may generate conversation summary information and provide it to the called party. In other words, if the called party is unable to directly process the contact request, at step 1350, the server 150 may use artificial intelligence to converse with the caller to directly process the contact, and at step 1360, As a result of the processing, summary information may be generated and provided to the called party.

In some embodiments, server 150 may immediately communicate a received contact request to the called party. At this time, the called party's electronic device 1 (110) may determine whether the called party's direct control is possible based on the above-described schedule information, lifestyle information, and/or the called party's input. If direct control of the called party is not possible, a request to process the contact may be sent to server 150 . In this case, the server 150, in response to the contact processing request, processes the response using artificial intelligence as in steps 1350 and 1360, generates summary information of the conversation as a result of the processing, and sends it to the called party. may provide. The summary information provided to electronic device 1 (110) may be reported to the callee when the callee's direct control is enabled.

In some embodiments, server 150 may also directly perform post-processing of conversations, such as scheduling or registering alarms. For example, the server 150 extracts information on at least one of the date, time, and location included in the content of the conversation, associates the extracted at least one information with information on the caller of the contact, and receives an incoming call. You may register schedules or alarms for people. Registered schedules and alarms may be synchronized to the electronic device 1 (110).

The server 150 may directly process the conversation with the caller using the artificial intelligence implemented in the server 150, but may work with the cloud artificial intelligence platform 320 to process the conversation.

As described above, according to embodiments of the present invention, artificial intelligence can be used to match the user's schedule and lifestyle with external contact requests such as voice calls, video calls, and/or receiving instant messages. can be reflected and processed. In addition, by generating and providing a summary sentence of the conversation in response to the artificial intelligence response, the user can grasp the content of the response automatically processed using artificial intelligence. In addition to this, the user can select artificial intelligence response when directly handling a contact request, and display a selfie video on the preview screen during a video call, so that the user can receive the call before accepting the video call. can provide time to check the appearance of

The systems or devices described above may be realized by hardware components, software components, or a combination of hardware and software components. For example, the devices and components described in the embodiments may include, for example, processors, controllers, ALUs (arithmetic logic units), digital signal processors, microcomputers, FPGAs (field programmable gate arrays), PLUs (programmable logic units), microcontrollers, It may be implemented using one or more general purpose or special purpose computers, such as a processor or various devices capable of executing instructions and responding to instructions. A processing unit may run an operating system (OS) and one or more software applications that run on the OS. The processing unit may also access, store, manipulate, process, and generate data in response to executing software. For convenience of understanding, one processing device may be described as being used, but those skilled in the art will appreciate that the processing device may include multiple processing elements and/or multiple types of processing elements. You can understand. For example, a processing unit may include multiple processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include computer programs, code, instructions, or a combination of one or more of these, to configure a processor to operate at its discretion or to independently or collectively instruct a processor. You can Software and/or data may refer to any kind of machine, component, physical device, virtual equipment, computer storage medium for interpretation on or for providing instructions or data to a processing device. or may be embodied in a device. The software may be distributed over computer systems connected by a network so that they are stored and executed in a distributed fashion. Software and data may be stored on one or more computer-readable media.

The method according to the embodiments may be embodied in the form of program instructions executable by various computer means and recorded on a computer readable medium. The computer-readable media may include program instructions, data files, data structures, etc. singly or in combination. The program instructions recorded on the media may be those specially designed and constructed for an embodiment, or they may be of the kind known and available to those of skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and floptical disks. and magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Such a recording medium may be a variety of recording means or storage means in the form of a combination of single or multiple hardware, and is not limited to a medium directly connected to a computer system, and may be used on a network. It may exist in a distributed manner. Examples of program instructions include high-level language code that is executed by a computer, such as using an interpreter, as well as machine language code, such as that generated by a compiler.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and variations based on the above description. For example, the techniques described may be performed in a different order than in the manner described and/or components such as systems, structures, devices, circuits, etc. described may be performed in a manner different than in the manner described. Appropriate results may be achieved when combined or combined, opposed or substituted by other elements or equivalents.

Accordingly, different embodiments that are equivalent to the claims should still fall within the scope of the appended claims.

110, 120, 130, 140: electronic equipment 150, 160: server 170: network

Claims (10)

A contact control program executed by a terminal,
the process of receiving contact requests from callers;
processing the contact by conversing with the caller of the contact using artificial intelligence based on the request of the contact;
causing the computer of the terminal to execute a process of acquiring summary information of the conversation and a process of providing the summary information to the called party;
A contact control program, wherein the summary information includes summary information about the type of contact and content of the conversation. A contact control program executed by a terminal,
the process of receiving contact requests from callers;
processing the contact by conversing with the caller of the contact using artificial intelligence based on the request of the contact;
causing the computer of the terminal to execute a process of acquiring summary information of the conversation and a process of providing the summary information to the called party;
The contact control program, wherein the summary information includes a time at which the request for contact was received and summary information regarding content of the conversation. Between the process of receiving the contact request and the process of processing the contact, a process of determining whether the callee can directly control the contact request based on the status of the callee. causes the terminal computer to execute
The contact control program according to claim 1 or 2. causing the computer of the terminal to execute a process of determining the status of the called party by analyzing information acquired in relation to the called party in the determining process;
The contact control program according to claim 3. The information acquired in relation to the called party is information managed by the terminal of the called party or an external device capable of communicating with the terminal.
The contact control program according to claim 4. the information obtained in relation to the called party is information related to at least one of the called party's schedule and the called party's lifestyle;
The contact control program according to claim 4. a communication unit that receives a contact request from a caller;
a processing unit for processing the contact by conversing with the caller of the contact using artificial intelligence based on the request for the contact;
with
The processing unit is
obtaining summary information of said conversation;
performing a process of providing the summarized information to a called party;
The terminal, wherein the summary information includes summary information about the type of contact and content of the conversation. a communication unit that receives a contact request from a caller;
a processing unit for processing the contact by conversing with the caller of the contact using artificial intelligence based on the request for the contact;
with
The processing unit is
obtaining summary information of said conversation;
performing a process of providing the summarized information to a called party;
The terminal, wherein the summary information includes summary information about the time when the request for contact was received and the content of the conversation. A contact control method comprising:
receiving a request for contact from a caller;
utilizing artificial intelligence to converse with the caller of the contact to process the contact based on the request for the contact;
obtaining summary information of the conversation;
providing said summary information to a called party;
including
The contact control method, wherein the summary information includes summary information about the type of contact and content of the conversation. A contact control method comprising:
receiving a request for contact from a caller;
utilizing artificial intelligence to converse with the caller of the contact to process the contact based on the request for the contact;
obtaining summary information of the conversation;
providing said summary information to a called party;
including
The contact control method, wherein the summary information includes a time when the contact request was received and summary information about the content of the conversation.

Images