KR102447503B1 - Message Service Providing Device and Method Providing Content thereof - Google Patents

Abstract

An electronic device for providing a message service according to an embodiment of the present invention includes: a communication unit for transmitting and receiving a message to and from a counterpart device; a display for displaying a received message, a message input by a user of the electronic device, and at least one reply message provided by the electronic device together on the message service screen; and recommending at least one content using the received message, and sending a reply message including the recommended at least one content to the counterpart device to be displayed as a message input by the user of the electronic device in the counterpart device. It may include a processor that provides a reply message.

Description

Electronic device providing message service and method of providing content by the electronic device {Message Service Providing Device and Method Providing Content thereof}

The present invention relates to a method for providing content to a user during a conversation and an electronic device therefor.

With the recent rapid increase in the penetration rate of portable terminals, portable terminals have become a necessity in modern life. Such a portable terminal is capable of providing various data transmission services and various additional services as well as a unique voice call service, thereby providing various functions.

In particular, communication between users is activated using smart terminals. Along with this trend of activation, various technologies that provide a more convenient conversational environment in communication are being developed.

An object of the present invention is to provide a method of providing a more convenient conversation environment while using various electronic devices.

As a technical means for achieving the above-described technical problem, a first aspect of the present disclosure includes a communication unit for transmitting and receiving a message to and from a counterpart device; a display for displaying a received message, a message input by a user of the electronic device, and at least one reply message provided by the electronic device together on the message service screen; and recommending at least one content using the received message, and sending a reply message including the recommended at least one content to the counterpart device to be displayed as a message input by the user of the electronic device in the counterpart device. An electronic device including a processor for providing a reply message may be provided.

1 is a block diagram illustrating a content providing system according to an embodiment of the present invention.
2 is a diagram illustrating a user interface (UI) of an electronic device for explaining an embodiment of the present invention.
3 is a flowchart illustrating a content providing method of an electronic device according to an embodiment of the present invention.
4 to 7 are diagrams for explaining a content providing method according to an embodiment of the present invention.
8 is a view for explaining various types of electronic devices and various chatting methods that can use the content providing method according to the present invention.
9A is a diagram for explaining the knowledge framework 120 that provides answer-related content included in an electronic device.
9B is a diagram for explaining the operation of each block diagram in the electronic device 100 according to an embodiment of the present invention.
10A to 10D are diagrams illustrating an environment setting user interface provided by an electronic device according to an embodiment of the present invention.
11A to 11D are diagrams illustrating a method for an electronic device to provide answer-related content.
12A is a flowchart illustrating a method of providing content related to an answer by an electronic device.
12B is a diagram illustrating modules included in the electronic device and the server, respectively.
13A is a flowchart illustrating a method of providing answer-related content by an electronic device.
13B is a diagram illustrating modules included in the electronic device and the server, respectively.
14A is a flowchart illustrating a method of providing content related to an answer by an electronic device.
14B is a diagram illustrating modules included in the electronic device and the server, respectively.
15 is a diagram for explaining a method of utilizing content stored in a database of a server in order to identify a relationship between users.
16 is a diagram for explaining a method of utilizing content stored in a database of an electronic device in order to identify a relationship between users.
17 is a diagram for explaining a method of utilizing content stored in a database of an electronic device and content stored in a database of a server in order to identify a relationship between a user of the electronic device and a user of a counterpart device.
18 to 24 are diagrams for explaining a content providing method according to an embodiment of the present invention.
25A to 25E are diagrams illustrating a content providing screen when content available for an answer is provided according to an embodiment of the present invention.
26 is a diagram illustrating that an electronic device provides an interface for changing a content providing layout.
27 to 37 are diagrams for explaining a content providing method according to an embodiment of the present invention.
38 to 48 are diagrams for explaining a content providing method according to an embodiment of the present invention.
49 is a block diagram illustrating a configuration of a user terminal device according to an embodiment of the present disclosure, and the user terminal device shown in FIG. 49 may be the electronic device of FIG. 1 .
49 to 53 are diagrams for comprehensively explaining a content providing method according to an embodiment of the present invention.
54(a) to 54(d) are diagrams for explaining a content providing method according to an embodiment of the present invention.
55(a) to 55(d) are diagrams for explaining a content providing method according to an embodiment of the present invention.
56 is a block diagram illustrating a software configuration of a user terminal device according to an embodiment of the present disclosure.
57 is a diagram illustrating a user interface (UI) of an electronic device for explaining an embodiment of the present invention.
58 is a diagram illustrating a user interface (UI) of an electronic device 2000 for explaining an embodiment of the present invention.

The terms used in the present invention have been selected as currently widely used general terms as possible while considering the functions in the present invention, but these may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than the name of a simple term.

In the entire specification, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, throughout the specification, when a certain part is said to be "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element interposed therebetween. include In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

Throughout the specification, "user" may mean a user of an electronic device. Throughout the specification, a message service may refer to a one-to-one, one-to-many, and many-to-many service that facilitates the exchange of messages between users, such as conversations between users. have.

Throughout the specification, an application refers to a set of computer programs designed to perform a specific task. The applications described herein may vary. For example, there may be a game application, a video playback application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, a payment application, a photo folder application, and the like, but is not limited thereto. An application may be expressed as an app.

Throughout the specification, an application refers to a set of computer programs designed to perform a specific task. The applications described herein may vary. For example, there may be a game application, a video playback application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, a payment application, a photo folder application, and the like, but is not limited thereto. An application may be expressed as an app.

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the embodiments of the present invention. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

In the present specification, a message is a part of a conversation exchanged between users, and is a unit bundle of text including at least one of one or more words, one or more phrases, and one or more phrases or a unit bundle of voices. can mean

In this specification, a keyword means a word, a phrase, and a phrase related to the meaning of the messages obtained by natural language interpretation of the messages, and includes not only words included in the message, but also words not included in the message. , may mean a phrase and a clause.

In the present specification, content may refer to data, files, software, and information including images, voices, and texts that transmit information through electronic devices. For example, the image content may mean image data transmitted through an electronic device. For example, the content may include content for an application service that provides a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text answer composed of various languages, and various services.

[One. Basic concept of invention]

1 is a block diagram illustrating a content providing system according to an embodiment of the present invention.

As shown in FIG. 1 , the content providing system 10 may include an electronic device 100 , a counterpart device 200 , and a server 300 .

The electronic device 100 according to an embodiment of the present invention may transmit/receive at least one of a text message or a voice message to/from the counterpart device 200 . Also, the electronic device 100 may transmit/receive at least one of a text message or a voice message to and from the counterpart device 200 through the server 300 .

In addition, the electronic device 100 may request and obtain various data from the server 300 , and may transmit various data to the server 300 . For example, data obtained by the electronic device 100 from the server 300 may be data exchanged between the counterpart device 200 and the server 300 .

However, the illustrated components are not essential components of the present invention. The content providing system 10 may be implemented by more elements than the illustrated elements, and the content providing system 10 may be implemented by fewer elements than that. For example, in another embodiment of the present invention, the server 300 may not be included in the content providing system 10 .

Hereinafter, each configuration will be described.

The electronic device 100 according to an embodiment of the present invention may transmit/receive a message to/from the counterpart device 200 .

In the present specification, the electronic device 100 is a smart phone, a tablet PC, a wearable device, a personal digital assistant (PDA), a laptop computer, a mobile phone, and a mobile phone. Mobile Phone, Enterprise Digital Assistant (EDA), Portable Multimedia Player (PMP), Personal Navigation Device or Portable Navigation Device (PND), Handheld Game Console, Mobile Internet Device (MID) ), or may be implemented as an e-book.

In the present specification, the wearable device may include a head mounted display (HMD: Head mounted display, hereinafter referred to as 'HMD') that can be mounted on the head. For example, the head mounted display HMD may include, but is not limited to, glasses, a helmet, a hat, and the like. In the present specification, the wearable device may be implemented in the form of a ring, a necklace, a bracelet, a shoe, an earring, a hairband, clothes, a glove, and a thimble.

The counterpart device 200 may be a device that receives the first message generated by the electronic device 100 and displays the first message on an output interface. Also, the counterpart device 200 may generate a second message according to a user input and transmit the second message to the electronic device 100 .

According to an embodiment of the present invention, the counterpart device 200 receives the first message from the electronic device 100 through the server 300 and transmits the second message to the counterpart device 200 through the server 300 . can be transmitted According to another embodiment of the present invention, the counterpart device 200 may directly receive the first message from the electronic device 100 without going through the server 300 and directly transmit the second message to the electronic device 100 . . In another embodiment, there may be one or a plurality of counterpart devices 200 .

The counterpart device 200 according to an embodiment of the present invention may be implemented in various forms. For example, the counterpart device 200 described herein may include a smart phone, a tablet PC, a wearable device, a personal digital assistant (PDA), a laptop computer, and a mobile phone. (Cell Phone), Mobile Phone, EDA (Enterprise Digital Assistant), PMP (Portable Multimedia Player), PND (Personal Navigation Device or Portable Navigation Device), Handheld Game Console, Mobile Internet Device ( Mobile Internet Device (MID)), or may be implemented as an e-book.

The server 300 may communicate with the electronic device 100 or the counterpart device 200 . For example, the server 300 may receive a first message generated in the electronic device 100 from the electronic device 100 and receive a second message generated in the counterpart device 200 from the counterpart device 200 . can In addition, the server 300 may transmit the first message to the counterpart device 200 and transmit the second message to the electronic device 100 .

The server 300 may manage a message received from the electronic device 100 or the counterpart device 200 . For example, the server 300 may store the transmitted and received messages in a message DB (Database) for each device. And the server 300 may update the message DB. The server 300 may update the message DB at a certain time period, or whenever a new message is received from the electronic device 100 or the counterpart device 200 , the message DB may be updated.

2 is a diagram illustrating a user interface (UI) of the electronic device 100 for explaining an embodiment of the present invention.

Referring to FIG. 2 , the electronic device 100 according to an embodiment of the present invention may extract a keyword from a message received from the counterpart device 200 . Also, the electronic device 100 may acquire at least one content usable when responding to a message based on one keyword. Also, the electronic device 100 may display at least one obtained content.

The electronic device 100 includes a back button 20 , a voice call button 30 , a user name box 40 and messages 50 , 51 , 52 , 53 . An interface such as a dialog box can be provided. A back button 20 and a call connection button 30 may be displayed on the user name box 40 .

The user may return to the previous menu by touching or double-tapping the back button 20 . The user may perform voice chatting or a voice call by touching or double-tapping the call connection button 30 . The user name box 40 may display the name or nickname of the conversation partner. Also, the user name box 40 may display the user's name or nickname of the electronic device 100 . The chat window may display messages 50 , 51 , 52 , 53 exchanged between the user and the chat partner.

The electronic device 100 may determine whether it is a question for each message 50 , 51 , 52 , 53 . When any one of the messages 50 , 51 , 52 , and 53 is a question, the electronic device 100 may extract a keyword from the messages 50 , 51 , 52 , 53 . The electronic device 100 may acquire content usable when responding to a message based on the extracted keyword.

The electronic device 100 may receive an input from the user on whether to display the acquired content through the pop-up window 60 for each keyword. The electronic device 100 may display the acquired content when the user touches or taps the first response button 61 . The electronic device 100 may not display the acquired content when the user touches or taps the second response button 62 .

When any one of the messages 50 , 51 , 52 , and 53 is a question, the electronic device 100 may acquire content available when answering the question before activating the pop-up window 60 . Alternatively, when any one of the messages 50 , 51 , 52 , and 53 is a question, the electronic device 100 may activate the pop-up window 60 and obtain content available when answering the question. Alternatively, if any one of the messages 50 , 51 , 52 and 53 is a question, the electronic device 100 responds to the question after the user touches the first response button 61 after activating the pop-up window 60 . It is possible to acquire available content when answering the question.

3 is a flowchart illustrating a content providing method of the electronic device 100 according to an embodiment of the present invention.

[1.1. receive message]

Referring to FIG. 3 , the electronic device 100 may receive a message from the counterpart device 200 ( S110 ).

The electronic device 100 may receive messages 50 , 51 , 52 , and 53 from the counterpart device 200 . Alternatively, the electronic device 100 may receive the messages 50 , 51 , 52 , 53 from the counterpart device 200 through the server 300 .

The electronic device 100 may determine whether each of the messages 50 , 51 , 52 , and 53 corresponds to a question. The electronic device 100 may determine whether it is a question through the methods of semantic analysis and statistical analysis, which will be described later.

[1.2. keyword extraction]

The electronic device 100 may extract a keyword from the message received from the counterpart device (S130).

The electronic device 100 may extract a keyword from the message through semantic analysis and probabilistic analysis.

The electronic device 100 may extract keywords through semantic analysis.

For example, the electronic device 100 may receive the message 53 'where are you?' from the counterpart device 200 . The electronic device may extract the keyword as 'where' by grasping the meaning of the message 53 . In addition, the electronic device may extract the keyword as 'where' by additionally considering the conversation content between users and user-related data. The user-related data may include at least one of content input by the user and record data for the user. The user-related data may mean only content related to one user, and may mean content related to two or more users.

The electronic device may extract the keyword as 'where' based on at least one of the meaning of the message, the content input by the user, and the recorded data about the user.

The electronic device may extract a keyword by analyzing the meaning of the message in natural language. For example, an electronic device may extract the keyword 'where'. The electronic device may check the meaning of a message included in a conversation between users, and predict what content the user needs based on the meaning of the message. For example, the electronic device may analyze the meaning of the message as that the user of the other device asks about the location of the user of the electronic device. Based on this meaning, the electronic device may predict that it is necessary for the user to provide an answer to his/her location to the user of the other device, and may extract the keyword as 'where'.

In addition, when extracting a keyword based on the meaning of the message, the electronic device may consider the content input by the user. For example, the content input by the user may include the user's home address, the user's work address, the user's moving route record, and a place according to the user's scheduled schedule. For example, if the user records a business trip through the scheduler application and the content of the message exchanged with the other device is about the business trip location, the electronic device can extract the keyword 'where'.

In addition, when extracting a keyword based on the meaning of the message, the electronic device may consider the recorded content for the user. For example, the record of the user may mean the record of the user recorded in the electronic device and the server. Also, the record of the user may include a record recorded by the user while using an electronic device and a record recorded in a server while using an app service. In addition, the record of the user may include content recorded indirectly while the user uses the electronic device or the server, although the user has not directly recorded it.

For example, the record of the user may include the user's call history, the payment history through the user's credit card, and the content recorded by the user through a social network service (SNS).

The electronic device may extract a keyword by grasping the meaning of the message through statistical analysis.

For example, the electronic device may determine the priority among the user's predicted situations. For example, the electronic device may determine that one of the one or more situations predicted by the user has a high probability of occurrence. For example, the electronic device may determine that any one of the one or more keywords has a high occurrence probability.

The electronic device may extract the keyword as 'where' through statistical analysis and semantic analysis in the manner described above.

[1.3. Acquisition of content]

The electronic device 100 may acquire content available when responding to a message based on the extracted keyword (S170).

The electronic device 100 may acquire content by performing various searches based on the extracted keyword. The content obtained by the electronic device 100 is a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text answer composed of various languages, content in various fields, and an application service (App Service) that provides various services. content may be included.

In an embodiment of the present invention, the electronic device 100 may acquire content related to a keyword from an external search server.

For example, the electronic device 100 may acquire content for an application service (App Service) related to a keyword.

For example, when the received message is in the form of a question, the electronic device 100 may analyze the message to acquire content for the weather application service.

For example, when the received message is not in the form of a question, but it is recognized that an answer is required as a result of semantic analysis, the electronic device 100 may obtain the content by using a matching table or using a predetermined rule.

For example, the electronic device 100 may determine an application service that a user can use for an answer according to a keyword in consideration of conversation content and user-related data.

For example, when the user is located in Korea, the electronic device 100 selects a map-related application service provided by a service provider of Korean nationality, and when the user is located in Japan, Japan You can select a map-related application service provided by a service provider of your nationality.

Also, for example, the electronic device 100 may select a map application service frequently used by the user of the electronic device 100 with reference to the frequency of use of the application (App) of the user.

Also, for example, the electronic device 100 may select an application service suitable for a current situation from among application services previously selected by the user.

For example, the electronic device 100 may select a first application service (App Service) according to the current situation of the user from among the first application service (App Service) to the fifth application service (App Service) selected in advance by the user. have. For example, if there is a first restaurant application service (App Service) to a fifth restaurant application service (App Service) selected in advance by the user, a map-related application service (App Service) suitable for the user's current situation is selected. can

Also, the electronic device 100 may acquire content through an Internet search service. For example, after determining the Internet search service, the electronic device 100 may acquire content by performing various searches based on keywords. For example, the Internet search service may be a commercialized search service such as yahoo, google, bing, or naver. For example, the Internet search service may be a search service that only a specific person can access, such as a university library, a thesis search site, or a database of a research facility.

For example, the electronic device 100 may acquire a two-dimensional image corresponding to a keyword by using a commercialized search service such as yahoo. For example, the electronic device 100 may acquire content in various fields by inputting a keyword as an input value to a commercialized search service such as yahoo.

In another embodiment of the present invention, the electronic device 100 may acquire related content stored in the electronic device 100 .

For example, the electronic device 100 stores data about a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text answer in various languages, and content in various fields stored in the electronic device 100. can be obtained

[1.4. Provision of content]

The electronic device 100 may provide at least one obtained content (S190).

The electronic device 100 may provide the content obtained based on the keyword to the user in various ways.

For example, the electronic device 100 may provide the acquired content to the user through at least one of a voice, an image, and a text. For example, a method in which the electronic device 100 provides the acquired content may vary depending on the type of the electronic device 100 . For example, the electronic device 100 may display content in a screen division and screen switching method, and if the electronic device 100 is a wearable device such as a smart watch, the content may be displayed in summary. For example, the electronic device 100 may display content as voice or image through an avatar, and if the electronic device 100 is a wearable device such as a smart watch, may display the content in summary.

For example, the electronic device 100 may acquire a two-dimensional image corresponding to a keyword by using a commercialized search service such as yahoo. For example, the electronic device 100 may acquire content in various fields by inputting a keyword as an input value to a commercialized search service such as yahoo.

[2. Scenario 1]

4 to 7 are diagrams for explaining a content providing method according to an embodiment of the present invention. 4 to 7 are diagrams illustrating a user interface step by step for a scenario in which an electronic device provides an image stored in an electronic device as answer-related content to a user while providing a text chatting service.

Referring to FIG. 4 , Chris, a user of an electronic device, is having a text chat with Hyunjin, a user of the other device.

The electronic device displays the name of the user of the electronic device through the user name box 40 . In another embodiment of the present invention, the electronic device may display the user of the counterpart device through the user name box 40 .

The electronic device receives the message 'Hi~!' (50) from Chris's counterpart at 8:26 on August 6, 2013. The electronic device transmits the message 51 to the counterpart device and receives the message 52 from the counterpart device. The user of the electronic device receives a message from Hyunjin saying 'Where are you?'.

The electronic device may determine whether each of the messages 50 , 51 , 52 , 53 is a question. For example, the electronic device may determine that each of the messages 50 , 51 , and 52 is not a question, and may determine that the message 53 is a question.

For example, the electronic device may mark a message determined to be a question to be distinguished from other messages. For example, the electronic device may mark a message determined to be a question with a different color (eg, fluorescent yellow) to distinguish it from other messages.

The electronic device may extract a keyword for the message 53 . For example, the electronic device may extract the keyword 'current location' with respect to the message 53 . Alternatively, for example, the electronic device may extract the keyword 'where am I?' with respect to the message 53 . Alternatively, for example, the electronic device may extract keywords in consideration of user-related data such as 'UK' or 'Seoul' with respect to the message 53 additionally.

Referring to FIG. 5 , the electronic device may display images 71 , 72 , and 73 related to a message 53 . The electronic device may display an image stored in the electronic device or an image stored in a server connected to the electronic device. If the electronic device determines that the message 53 is a question, it can display the related images 71 , 72 , 73 even without a separate input from the user. Alternatively, when the electronic device determines that the message 53 is a question, the electronic device may display the related images 71 , 72 , 73 as content available for answering with reference to a user input value in setting.

Referring to FIG. 6 , the electronic device may select one of displayed images through a user's touch input or a tap input.

Referring to FIG. 7 , the electronic device 100 may transmit the selection image 72 to the counterpart device 200 through a message 54 as an answer through the user's touch input or tap input. received from the electronic device 100 of the counterpart device 200

[2.1. Applicable devices and applications]

8 is a view for explaining various types of electronic devices and various chatting methods that can use the content providing method according to the present invention.

Referring to FIG. 8 , the content providing method according to the present invention may be performed during a communication process through voice chatting or text chatting between an electronic device and a counterpart device. In addition, the content providing method according to the present invention may be performed during a communication process through voice chatting accompanied by a speech to text (STT) function between the electronic device and the counterpart device. In addition, the electronic device 100 may be implemented as a smart phone, a tablet PC, a wearable device, or the like. In addition, the electronic device 100 may use the content providing method of the present invention as long as it can implement a message service among non-illustrated types of devices.

[2.2. Detailed composition of the mechanism]

FIG. 9A is a diagram for explaining the knowledge framework 120 that provides answer-related content included in the electronic device 100 .

The electronic device 100 may implement the knowledge framework 120 , the first application 141 , and the second application 143 , and store the web content list 145 and the device list 147 .

The knowledge framework 120 is a natural language processing unit (NLU, 121), a session manager (Session Manager, 122), a profiler (Profiler, 123), a context analyzer (Context Analyzer, 124), and a response generator (Response Generator, 125). , it may include a content metadata storage unit (Content Metadata Storage, 126) and an App Register (App Register, 127).

The natural language processing unit 121 may analyze the meaning of each message received by the electronic device 100 . The natural language processing unit 121 may analyze the meaning of each message in a probabilistic manner. The natural language processing unit 121 may analyze each message through a probabilistic method and a semantic method and transmit it to the context analyzer 124 .

The session manager 122 may identify the message transmitted/received by the electronic device 100 in group units by identifying the conversation partner, the conversation date and time, the conversation content, and the conversation environment for the messages transmitted and received by the electronic device 100 . The session manager 122 may define a session by binding one or more messages transmitted and received by the electronic device 100 .

The profiler 123 may collect and store content for a user of the electronic device or a user who has transmitted and received messages with the user of the electronic device. The profiler 123 may store, process, and store content created by a user of the electronic device or a user who transmits/receives a message to and from the user of the electronic device.

The context analyzer 124 may determine the meaning of each message transmitted and received by the electronic device based on the meaning of the messages transmitted and received by the electronic device. The context analyzer 124 may determine the meaning of each message transmitted and received by the electronic device for each one or more message units defined by the session manager 122 .

The response generator 125 may generate an answer to the message. The response generator 125 may generate content that can be used in response to a message. The response generator 125 may generate various possible answers and provide them to the user through the interface screen.

The content metadata storage unit 126 may include metadata for content. For example, the content metadata storage unit 126 may include content for an application. For example, the content metadata storage unit 126 may include metadata on whether the application is a sports-related application or a movie-related application. Also, for example, the content metadata storage unit 126 may include metadata about the image. The content metadata storage unit 126 may include content such as names of persons appearing in the image and relationships with users of electronic devices.

For example, the content metadata storage unit 126 may continuously collect content for the web content list (Web Content, 145) on the Internet. For example, the content metadata storage unit 126 may continuously collect data about the device list (Device Content) 147 of the electronic device.

App register 127 may contain content for various applications. For example, the app register 127 may include data for an application included in the electronic device 100 . For example, the app register 127 may include data for an application not included in the electronic device 100 . The app register 127 may update data for the application from time to time. The response generator 125 may refer to the application-related data in the app register 127 to generate an application-related answer.

For example, the app register 127 may store data for at least one of the first application 141 and the second application 142 . For example, the first application 141 may be an application installed in the electronic device 100 . For example, the second application 143 may be an application not installed in the electronic device 100 .

9B is a diagram for explaining the operation of each block diagram in the electronic device 100 according to an embodiment of the present invention.

Referring to FIG. 9B , the electronic device 100 includes a session manager (Session Manager, 122), a profiler (Profiler, 123), a context analyzer (Context Analyzer, 124), and a content metadata storage unit (Content Metadata Storage, 126). ), an App Register (App Register, 127), a response recommender (Response Recommender, 128), and may include a web search engine (129).

The response recommender 128 may include a natural language processing unit (NLU) 121 and a response generator (125).

The session manager 122 may send a message um[n] to the response recommender 128 . The response recommender 128 may receive a message um[n] from the session manager 122, and the natural language processing unit 121 may generate a keyword kw[m] from the message um[n]. . For example, the session manager 122 may transmit a message (um[n]) of <where are you?> to the response recommender 128, and the natural language processing unit 121 may use a keyword (kw[) as location or information. m]) can be created.

The response recommender 128 may receive user information (usr.info) from the profiler 123 . For example, the response recommender 128 responds to the message <where are you?> (um[n]), user information in an external service account, the user's home or workplace, or the user frequently It is possible to receive information on places to enter and exit as user information (usr.info). When generating the keyword kw[m], the response recommender 128 may refer to the user information (usr.info) received from the profiler 123 .

The response recommender 128 may receive the context information (cnt.info) from the context analyzer 124 . For example, the context information (cnt.info) for the message <where are you?> (um[n]) includes time information, GPS information, weather information, analyzed user activity information, and recent logs. may include

For example, the user activity information may include information such as the fact that the user stayed at a restaurant for 1 hour and the fact that the user continued running for 1 minute. For example, recent logs may include networking information such as information on a base station to which an electronic device is connected. The response recommender 128 may consider the context information (cnt.info) when generating the recommendation response (rcm.ans) using the keyword (kw[m]).

The response recommender 128 may receive the app-related information (ap.info) by passing the keyword kw[m] to the app register 127 . For example, the app-related information (ap.info) may include metadata of an app or information about a map-related app.

The response recommender 128 may receive content information cm.info corresponding to the keyword kw[m] from the content metadata storage unit 126 . For example, the content information (cm.info) may include detailed information of an image. For example, the detailed information of the image may include a location (latitude, longitude) of the image or tag information.

The response recommender 128 may transmit the keyword kw[m] to the web search engine 129 to receive the search result value srch.rst. For example, the search result value srch.rst may include an image of Boston, an office address, a map app, and the like.

The response recommender 128 receives at least one of app-related information (ap.info), content information (cm.info), and a search result value (srch.rst), and user information (usr.info) and context information With reference to (cnt.info), a recommended response (rcm.ans) corresponding to the message (um[n]) may be generated.

[2.3. Preferences]

10A to 10D are diagrams illustrating an environment setting user interface provided by the electronic device 100 according to an embodiment of the present invention.

The term “setting” may refer to predetermining an operation method of the electronic device by a user setting or by a user input in order to set the use environment of the electronic device.

Referring to FIG. 10A , according to a setting, the electronic device 100 may not provide answer-related content and may provide answer-related content. When the electronic device 100 provides answer-related content according to the setting, the electronic device 100 automatically (Auto), semi-auto (Semi-Auto), manual (Manual) to provide the answer-related content can

If the electronic device 100 automatically provides answer-related content according to the environment setting (Setting), even if the electronic device 100 does not receive an additional input from the user when it is determined that the transmitted/received message is a question. It may mean providing content related to an answer to a message.

When the electronic device 100 determines that the transmitted and received message is a question, that the electronic device 100 provides answer-related content in a semi-automatic manner according to the setting, the user's response to the corresponding message When a simple input (touch or tap input) is received, it may mean providing content related to an answer to a message.

For example, when the electronic device 100 provides answer-related content in a semi-automatic manner, a message corresponding to a question may be displayed separately from other messages. For example, the electronic device 100 may display a background color of a message corresponding to a question by distinguishing it from other messages in a different color. For example, the electronic device 100 may mark a message corresponding to a question to be distinguished from other messages by underlining the message.

The user of the electronic device 100 may receive the content by touching or tapping the display. The electronic device 100 may obtain an answer-related content by receiving an input such as a user's touch or tap. The electronic device 100 may obtain and store expected answer-related content before receiving an input such as a user's touch or tap, and then may provide answer-related content upon receiving an input such as a user's touch or tap.

When the electronic device 100 provides answer-related content according to the environment setting (Setting), the electronic device 100 provides answer-related content manually means that the electronic device 100 asks the message transmitted and received. If it is determined that , it may be checked whether to receive the answer-related content to the user, and when the user inputs that the answer-related content will be received, it may mean that the answer-related content is provided to the message.

Referring to FIG. 10B , the electronic device 100 may provide answer-related content in consideration of a condition related to a user specified in Setting.

For example, the electronic device 100 may provide the answer-related content in consideration of the content for the first user (User1) specified in the environment setting (Setting). Also, for example, the electronic device 100 may provide content related to an answer to a message transmitted and received by the second user User2. Also, for example, the electronic device 100 may provide content only for content input by the third user User3.

Referring to FIG. 10C , the electronic device 100 may provide answer-related content in consideration of a condition related to a time specified in Setting.

For example, if the electronic device 100 is set to provide answer-related content in Semi-Auto as described in FIG. 10A in Setting, a message corresponding to a question is displayed separately from other messages. time can be limited. For example, the electronic device 100 may limit the time for distinguishing and displaying a message corresponding to a question from other messages to 10 seconds, 20 seconds, 30 seconds, or 1 minute. When the corresponding time has elapsed, the electronic device 100 may no longer display the message corresponding to the question separately from other messages.

Referring to FIG. 10D , the electronic device 100 may provide answer-related content in consideration of data conditions in Setting.

For example, the electronic device 100 may understand the question content by referring only to data stored in the electronic device. For example, the electronic device 100 may understand the question content by referring only to data stored in the electronic device and the server.

For example, the electronic device 100 may provide answer-related content by referring only to data stored in the electronic device. For example, the electronic device 100 may provide answer-related content by referring only to data stored in the electronic device and the server.

In addition to those shown in FIGS. 10A to 10D , the electronic device 100 may operate in various forms through environment settings. For example, the user of the electronic device 100 may set the answer-related content to be provided as text, voice, image, or the like. For example, the user of the electronic device 100 may set a field of interest that requires content provision. For example, the user of the electronic device 100 may set the field of interest to items such as sports, weather, politics, movies, economy, and life.

[2.4. Terminal-oriented service provision]

11A is a diagram illustrating a method in which the electronic device 100 provides answer-related content.

Referring to FIG. 11A , the electronic device 100 may receive a message from the counterpart device 200 ( S210 ). The electronic device 100 may continuously receive messages from the counterpart device 200 . The electronic device 100 may receive a message from the counterpart device 200 through the server 300 .

The electronic device 100 may determine whether the message received from the counterpart device 200 is a question (S220). The electronic device 100 may classify the sentences used in the message into grammatical components and extract a relationship between the respective grammatical components. The electronic device 100 may determine whether the received message is a question based on the result of this operation.

The electronic device 100 may extract a keyword from the message received from the counterpart device (S230). The electronic device 100 may extract a keyword from the received message through natural language interpretation. When extracting the keyword, the electronic device 100 may extract the keyword with reference to data input by the user and record data for the user.

The electronic device 100 may acquire available content when responding to a message based on the keyword (S250). The electronic device 100 may acquire content by performing various searches based on the extracted keyword. The content obtained by the electronic device 100 is a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text answer composed of various languages, content in various fields, and an application service (App Service) that provides various services. content may be included.

The electronic device 100 may provide the obtained at least one content (S270). For example, the electronic device 100 may provide the acquired content to the user through at least one of a voice, an image, and a text.

11B is a diagram illustrating a method for the electronic device 100 to provide answer-related content.

Referring to FIG. 11B , the electronic device 100 may receive a message from the counterpart device 200 ( S310 ).

The electronic device 100 may determine whether it is necessary to receive available content when responding to a message received from the counterpart device 200 ( S320 ). For example, the electronic device 100 may determine whether it is necessary to be provided with content that can be used in response to a received message based on items set by the user through environment setting.

The electronic device 100 may extract a keyword from the message received from the counterpart device (S330). The electronic device may extract a keyword by analyzing the meaning of the message in natural language.

The electronic device 100 may acquire available content when responding to a message based on the keyword ( S350 ). The electronic device 100 may acquire content related to a keyword from an external search server. The electronic device 100 may acquire content through an Internet search service. The electronic device 100 may acquire related content stored in the electronic device 100 .

The electronic device 100 may provide a list of acquired contents (S370). The electronic device 100 may provide the content obtained based on the keyword to the user in various ways.

11C is a diagram illustrating a method for the electronic device 100 to provide answer-related content.

Referring to FIG. 11C , the electronic device 100 may receive a message from the counterpart device 200 ( S410 ). The electronic device 100 may extract one or more keywords from the message received from the counterpart device (S430).

The electronic device 100 may prioritize one or more keywords based on internal data of the electronic device 100 or an input from a user (S440). The electronic device 100 may determine priorities between keywords and refer to them for content acquisition. For example, the electronic device 100 may acquire content through a plurality of keywords, but may acquire content for a keyword having a higher priority as a priority, and may acquire content for a keyword having a lower priority as a lower priority. For example, the electronic device 100 may acquire content through a plurality of keywords, but display content for a keyword having a high priority as a priority, and display content for a keyword with a low priority as a lower priority.

The electronic device 100 may obtain content usable when responding to a message based on the keyword and provide at least one content through various methods (S450 and S470).

11D is a diagram illustrating a method for the electronic device 100 to provide answer-related content.

Referring to FIG. 11D , the electronic device 100 may receive a message from the counterpart device 200 ( S510 ).

The electronic device 100 may extract a keyword from the message received from the counterpart device (S530).

The electronic device 100 may analyze relationship data between the user of the other device and the user of the electronic device (S540). The relationship data between the user of the counterpart device and the user of the electronic device may refer to data stored in the electronic device or the server.

The electronic device 100 may acquire content available when responding to a message based on the analyzed keyword and relationship data between users ( S550 ). Also, the electronic device 100 may provide at least one content through various methods (S570).

12A is a flowchart illustrating a method of providing content related to an answer by the electronic device 100. Referring to FIG.

The electronic device 100 may receive the first message from the counterpart device 200 (S1005). The electronic device 100 may receive the first message from the counterpart device 200 through the server 300 .

The electronic device 100 may determine whether the first message received from the counterpart device 200 is a question (S1010). The electronic device 100 may determine whether the received first message is a question through natural language interpretation.

When the received first message is a question, the electronic device 100 may extract a keyword from the message (S1020).

The electronic device 100 may request the server 300 to obtain content based on the keyword (S1025). The server 300 may acquire the content available for answering the message based on the keyword (S1030).

The server 300 may provide the content obtained based on the keyword to the electronic device 100 (S1035). The electronic device 100 may provide the obtained content (S1040).

The electronic device 100 may transmit the second message to the counterpart device 200 (S1045). For example, the electronic device 100 may include at least one obtained content in the second message and transmit it to the counterpart device 200 .

12B is a diagram illustrating modules included in the electronic device 100 and the server 300, respectively.

12B is an exemplary diagram for explaining a method of acquiring answer-related content centering on the electronic device 100 . Detailed configurations included in the electronic device 100 and detailed configurations included in the server 300 may be changed in various ways.

12B, the electronic device 100 includes a session manager (Session Manager, 122), a profiler (Profiler, 123), a context analyzer (Context Analyzer, 124), and a response recommender (Response Recommender, 128) can do. The response recommender 128 may include a natural language processing unit NLU 121 and a response generator 125 .

The server 300 may include a content metadata storage unit 326 and an app register 327 .

The natural language processing unit 121 may analyze the meaning of the message received by the electronic device 100 . The natural language processing unit 121 may analyze the message through a probabilistic method or a semantic method and transmit it to the context analyzer 124 .

The session manager 122 may identify the message transmitted/received by the electronic device 100 in group units by identifying the conversation partner, the conversation date and time, the conversation content, and the conversation environment for the messages transmitted and received by the electronic device 100 . The session manager 122 may define a session by binding one or more messages transmitted and received by the electronic device 100 . For example, the session manager 122 may send a message (um[n], eg, where will you go afternoon?) to the response recommender 128 .

The response recommender 128 may receive a message um[n] from the session manager 122, and the natural language processing unit 121 may generate a keyword kw[m] from the message um[n]. . For example, the session manager 122 may deliver the message <where will you go afternoon?> to the response recommender 128, and the natural language processing unit 121 may use the keyword ( kw[m]) can be generated.

The profiler 123 may continuously collect, process, and store content for the user of the electronic device or persons related thereto. When generating the keyword (kw[m]), the response recommender 128 may receive and refer to user information (usr.info) related to the keyword (kw[m]) from the profiler 123 . For example, the user information (usr.info) for the message (um[n]) of <where will you go afternoon?> is the user information in the External Service Account, the user's home or work, or the user. It may include information about a place that is frequently accessed.

The context analyzer 124 may determine the meaning of each message transmitted and received by the electronic device based on the meaning of the messages transmitted and received by the electronic device. The context analyzer 124 may determine the meaning of each message transmitted and received by the electronic device for each one or more message units defined by the session manager 122 . The response recommender 128 may receive the context information (cnt.info) from the context analyzer 124 .

For example, the context information (cnt.info) for the message (um[n]) of <where will you go afternoon?> includes time information, GPS information, analyzed user schedule information, and recent logs (Recent Logs). may include For example, the response recommender 128 may consider the context information (cnt.info) when generating the recommendation response (rcm.ans) using the keyword (kw[m]).

The electronic device 100 may transmit the keyword kw[m] to the app register 327 to receive the app-related information (ap.info). For example, the app-related information (ap.info) for the message <where will you go afternoon?> (um[n]) includes information about the scheduler app, information about the social network service app, information about the chatting app, etc. can do. For example, the first application may be a weather-related application installed in the electronic device 100 . For example, the second application may be a news-related application that is not installed in the electronic device 100 .

The electronic device 100 may receive the content information cm.info by transmitting the keyword kw[m] to the content metadata storage unit 326 . For example, the response recommender 128 may receive data about a weather-related application and a news-related application from the content metadata storage 326 . For example, the content information (cm.info) for the message (um[n]) of <where will you go afternoon?> may include detailed information of an image or schedule-related information. For example, the detailed information of the image may include a place (latitude, longitude) of the image.

The response recommender 128 of the electronic device 100 receives at least one of app-related information (ap.info) and content information (cm.info) from the server 300, and user information (usr.info) and contact information A recommendation response (rcm.ans) corresponding to the message (um[n]) may be generated by referring to the information (cnt.info).

The response generator 125 may generate response-related content to the message. The response generator 125 may generate content that can be used in response to a message. The response generator 125 may provide the generated content to the user through the interface screen.

[2.5. Server-oriented service provision]

13A is a flowchart illustrating a method of providing content related to an answer by the electronic device 100. Referring to FIG.

The server 300 may receive the first message from the counterpart device 200 (S2010). The server 300 may transmit the first message received from the counterpart device 200 to the electronic device 100 (S2020).

The server 300 may determine whether the first message received from the counterpart device 200 is a question (S2030).

When the received first message is a question, the server 300 may extract a keyword from the message (S2040).

The server 300 may acquire available content when responding to a message based on the keyword (S2050)

The server 300 may provide the content obtained based on the keyword to the electronic device 100 . The electronic device 100 may provide the obtained content (S2060).

The electronic device 100 may transmit the second message to the server 300 (S2070). For example, the electronic device 100 may include at least one obtained content in the second message and transmit it to the server 300 . The server 300 may transmit the second message to the counterpart device 200 (S2080).

13B is a diagram illustrating modules included in the electronic device 100 and the server 300, respectively.

13B is an exemplary diagram for explaining a method of acquiring answer-related content centering on the server 300 . Detailed configurations included in the electronic device 100 and detailed configurations included in the server 300 may be changed in various ways.

Referring to FIG. 13B , the electronic device 100 may include a profiler 123 and a context analyzer 124 .

The profiler 123 may continuously store, process, and store content created by the user of the electronic device or other users. The profiler 123 may receive a request from the server 300 and transmit user information (usr.info) to the server 300 .

The context analyzer 124 may determine the meaning of each message transmitted and received by the electronic device based on the meaning of the messages transmitted and received by the electronic device. The context analyzer 124 may receive the request of the server 300 and transmit the context information (cnt.info) to the server 300 .

The server 300 may include a session manager (Session Manager, 322), a content metadata storage (Content Metadata Storage, 326), an App Register (App Register, 327), and a Response Recommender (328). . The response recommender 328 may include a natural language processing unit NLU 321 and a response generator 325 .

The session manager 322 identifies the conversation partner, the conversation date and time, the conversation contents, and the conversation environment for the messages transmitted and received by the electronic device 100 and transmits and receives the messages transmitted and received by the electronic device 100 through the server 300 in a group unit can be grasped as The session manager 322 may define a session by binding one or more messages transmitted and received by the electronic device 100 . For example, the session manager 322 may transmit the received message um[n] to the response recommender 328 .

The response recommender 328 may receive a message um[n] from the session manager 322, and the natural language processing unit 321 may generate a keyword kw[m] from the message um[n]. . For example, the session manager 322 may transmit the message <Is there a hot issue in Boston?> to the response recommender 328, and the natural language processing unit 321 may use keywords as news, issue, topic, and location. (kw[m]) can be created.

The response recommender 328 may receive user information (usr.info) from the profiler 123 . For example, when generating the keyword kw[m], the response recommender 328 may refer to user information (usr.info) received from the profiler 123 . For example, user information (usr.info) may include age and preference. For example, the user information (usr.info) may include user information in an external service account (External Service Account).

The response recommender 328 may receive the context information (cnt.info) from the context analyzer 124 . For example, the response recommender 328 may consider the context information (cnt.info) when generating the recommendation response (rcm.ans) using the keyword (kw[m]). The context information (cnt.info) may include time, an analyzed user schedule, and recent logs.

The response recommender 328 receives at least one of app-related information (ap.info) and content information (cm.info), and receives user information (usr.info) and contact information ( cnt.info), a recommended response (rcm.ans) corresponding to the message (um[n]) may be generated. For example, the app-related information (ap.info) may include information about an app that provides news, magazines, and articles. For example, the content information cm.info may include an article and an image about Boston.

The response generator 325 may generate response-related content to the message. The response generator 325 may generate content that can be used in response to a message. The response generator 325 may transmit the generated content to the electronic device 100 .

[2.6. Provision of mixed terminal and server services]

14A is a flowchart illustrating a method of providing content related to an answer by the electronic device 100. Referring to FIG.

The server 300 may receive the first message from the counterpart device 200 (S3010). The server 300 may transmit the first message received from the counterpart device 200 to the electronic device 100 (S3020).

The server 300 may determine whether the first message received from the counterpart device 200 is a question (S3030). After transmitting the first message to the electronic device 100 , the server 300 may determine whether the first message is a question, and before transmitting the first message to the electronic device 100 , whether the first message is a question can judge

When the received first message is a question, the server 300 may extract a keyword from the message (S3040). The server 300 may transmit the keyword to the electronic device 100 (S3045).

The electronic device 100 may acquire the content available for answering the message based on the keyword (S3050). The electronic device 100 may display the acquired content based on the keyword.

The electronic device 100 may transmit the second message to the server 300 (S3060). For example, the electronic device 100 may include at least one obtained content in the second message and transmit it to the server 300 . The server 300 may transmit the second message to the counterpart device 200 (S3070).

14B is a diagram illustrating modules included in the electronic device 100 and the server 300, respectively.

14B is an exemplary diagram for explaining a method of acquiring answer-related content centering on the server 300 . Detailed configurations included in the electronic device 100 and detailed configurations included in the server 300 may be changed in various ways.

Referring to FIG. 14B , the electronic device 100 may include a first profiler 123 , a content metadata storage 126 , and an App Register 127 .

The first profilers Profilers 1 and 123 may collect and store data about a user of the electronic device 100 or other users. Data about the user may include data such as the user's name, occupation, phone number, interests, friend relationships, and travel records. The first profilers Profilers 1 and 123 may store, process, and store content created by the user of the electronic device 100 . The content created by the user of the electronic device 100 may include messages, memos, replies, and comments written by the user.

The content metadata storage unit 126 may include various types of data for content. For example, the content metadata storage unit 126 may include data on which type of application the application is. Also, for example, the content metadata storage unit 126 may include metadata such as an image creation date and an image creation location.

Also, for example, the content metadata storage unit 126 may continuously collect and store data on various web contents on the Internet and data on various contents of an electronic device.

App registers 127 may contain data for various applications. For example, the app register 127 may store data for at least one of a first application installed in the electronic device and a second application not installed in the electronic device.

The server 300 is a natural language processing unit (NLU, 321), a session manager (Session Manager, 322), a second profiler (Profiler 2, 323), a context analyzer (Context Analyzer, 324) and a response generator (Response Generator, 325) ) may be included.

The session manager 322 may identify the message transmitted and received by the server 300 in a group unit by identifying the conversationalist, the conversation date and time, the conversation contents, and the conversation environment for the messages transmitted and received by the server 300 . The session manager 322 may define a session by binding one or more messages transmitted and received by the server 300 .

The natural language processing unit 321 may analyze the meaning of the first message received by the server 300 . The natural language processing unit 321 may analyze the first message through a probabilistic method and a semantic method and transmit it to the context analyzer 324 .

The context analyzer 324 may determine the meaning of each message transmitted and received by the electronic device 100 based on the meaning of the messages transmitted and received by the electronic device 100 . The context analyzer 324 may determine the meaning of each message transmitted and received by the electronic device for one or more message units defined by the session manager 322 .

The response recommender 328 receives at least one of user information (usr.info[p]) and context information (cnt.info), and the user information (usr.info[p]) received from the electronic device 100 . ), app-related information (ap.info), and content information (cm.info) may be referred to to generate a recommendation response (rcm.ans) corresponding to the message (um[n]). The server 300 may transmit a recommendation response (rcm.ans) to the electronic device 100 .

[2.7. Interlocutor relationship analysis]

15 is a diagram for explaining a method of utilizing information stored in the database 370 of the server 300 in order to identify a relationship between users.

Referring to FIG. 15 , the server 300 may collect, manage, and analyze information about users through the database 370 and the database management unit 360 .

The database 370 may include data for various users. For example, the database 370 may store information about other users related to the user of the electronic device 100 . For example, the database 370 may include data on the intimacy between the user of the counterpart device 200 and the user of the electronic device 100 .

The database manager 360 may manage the database 370 . The database management unit 360 may manage various data recorded in the database 370 , and provides the data managed by the database management unit 360 to the electronic device 100 at the request of the electronic device 100 . can do.

The database manager 360 may manage what is recorded in the database 370 for each user. Also, the database manager 360 may manage what is recorded in the database 370 for each group. The database manager 360 may transmit data requested by the electronic device 100 to the electronic device 100 .

The electronic device 100 may edit and manage information stored in the server through the Relationship Finder 140 , the Intimacy Analyzer 150 , and the Friend List Database 190 .

The relationship detector 140 may determine a relationship between the user of the counterpart device 200 and the user of the electronic device 100 . The relationship detector 140 may receive information about the user of the other device 200 and the user of the electronic device 100 by requesting the database management unit 360 included in the server 300 , and the relationship between users can figure out The relationship detector 140 may determine a relationship between users by analyzing previous call records and conversations between users.

The intimacy analyzer 150 may analyze the intimacy between the user of the counterpart device 200 and the user of the electronic device 100 . For example, the intimacy analyzer 150 quantifies the intimacy between the user of the other device 200 and the user of the electronic device 100 (for example, data such as 1,2, 3, 10, etc. or grade 1, It can be calculated with the same data as grades 2 and 3). For example, the intimacy analyzer 150 may select which intimacy between the user of the counterpart device 200 and the user of the electronic device 100 is included in one or more predetermined categories. For example, the intimacy analyzer 150 selects one of categories such as 'family', 'friend', 'work' or 'school' for intimacy between the user of the other device 200 and the user of the electronic device 100 . can be analyzed in this way.

The friend list database 190 may store data analyzed by the relationship detector 140 and the intimacy analyzer 150 centered on the relationship between the electronic device 100 and the user. Here, the information included in the friend list database does not include only information about the user of the electronic device 100 and friends in a social sense, but also contacts the user through the electronic device 100 such as family, seniors and juniors, and relatives. It can include information about all possible people.

For example, the friend list database 190 may store information that the user of the counterpart device 200 and the user of the electronic device 100 are friends in a social network service (SNS). For example, the friend list database 190 may store information that the user of the counterpart device 200 and the user of the electronic device 100 have a family relationship or a relative relationship. For example, the friend list database 190 may store information that the user of the counterpart device 200 and the user of the electronic device 100 have a relationship between the employer and the employee at work. For example, the friend list database 190 may store information that the user of the counterpart device 200 and the user of the electronic device 100 have the same school senior-junior relationship.

FIG. 16 is a diagram for explaining a method of utilizing information stored in the database 170 of the electronic device 100 in order to identify a relationship between users.

Referring to FIG. 16 , the electronic device 100 includes a database 170 , a database analyzer 160 , a relationship detector 140 , an intimacy analyzer 150 , and a friend list database. , 190) can collect, manage, and analyze information about users.

The database 170 may include data on call records of various users and the user 100 of the electronic device. For example, the database 170 may store information about a call record between the user of the electronic device 100 and another user in real time. For example, the call record may include information such as a call time, a call location, a call start time, a call end time, and a call method (voice, message).

In addition, the database 170 may include data recorded in the address book or contact information of the user 100 of the electronic device. For example, the database 170 may include information such as a friend's work name, occupation, and family relationship.

The database analyzer 160 may analyze and manage data such as a call record or an address book included in the database 170 . The database analyzer 160 may analyze various data recorded in the database 170 , and may provide an analysis result for the data at the request of the relationship detector 140 or the affinity analyzer 150 .

The database analyzer 160 may manage what is recorded in the database 170 individually. Also, the database analyzer 160 may manage what is recorded in the database 170 for each group. The database analyzer 160 may transmit data requested by the relationship detector 140 or the affinity analyzer 150 to the electronic device 100 .

The relationship detector 140 may determine a relationship between the user of the counterpart device 200 and the user of the electronic device 100 . The relationship detector 140 may request the database analyzer 160 to determine the relationship between the user of the counterpart device 200 and the user of the electronic device 100 . The relationship detector 140 may analyze a previous call record between the user of the counterpart device 200 and the user of the electronic device 100 to determine the relationship between the user of the counterpart device 200 and the user of the electronic device 100 . .

The intimacy analyzer 150 may analyze the intimacy between the user of the counterpart device 200 and the user of the electronic device 100 . For example, the intimacy analyzer 150 quantifies the intimacy between the user of the other device 200 and the user of the electronic device 100 (for example, data such as 1,2, 3, 10, etc. or grade 1, It can be calculated with the same data as grades 2 and 3). For example, the intimacy analyzer 150 selects one of categories such as 'family', 'friend', 'work' or 'school' for intimacy between the user of the other device 200 and the user of the electronic device 100 . can be analyzed in this way.

The friend list database 190 may store data analyzed by the relationship detector 140 and the intimacy analyzer 150 centered on the relationship between the electronic device 100 and the user. The friend list database 190 of FIG. 16 is similar to the friend list database 190 of FIG. 15 .

17 shows information stored in the database 170 of the electronic device 100 and the database 370 of the server 300 in order to understand the relationship between the user of the electronic device 100 and the user of the counterpart device 200 . It is a diagram for explaining a method of utilizing stored information.

Referring to FIG. 17 , the electronic device 100 includes a database 170 , a database analyzer 160 , a relationship detector 140 , an intimacy analyzer 150 , and a friend list database. , 190) can collect, manage, and analyze information about users. The database 170 and the database analyzer 160 of FIG. 17 are similar to the database 170 and the database analyzer 160 of FIG. 16 . Hereinafter, overlapping descriptions will be omitted.

The server 300 may include a database da370 and a database management unit 360 . The database 370 and the database manager 360 of FIG. 17 are similar to the database 370 and the database manager 360 of FIG. 15 . Hereinafter, overlapping descriptions will be omitted.

The relationship detector 140 may determine a relationship between the user of the counterpart device 200 and the user of the electronic device 100 . The relationship detector 140 may request at least one of the database analyzer 160 and the database manager 360 to determine the relationship between users. The relationship detector 140 may analyze a previous call record between the user of the counterpart device 200 and the user of the electronic device 100 to determine the relationship between the user of the counterpart device 200 and the user of the electronic device 100 . . The relationship detector 140 may analyze the conversation content between the user of the counterpart device 200 and the user of the electronic device 100 to determine the relationship between the user of the counterpart device 200 and the user of the electronic device 100 .

The intimacy analyzer 150 may analyze the intimacy between the user of the counterpart device 200 and the user of the electronic device 100 . The intimacy analyzer 150 may request at least one of the database analyzer 160 and the database manager 360 to analyze the intimacy between the user of the counterpart device 200 and the user of the electronic device 100 .

For example, the intimacy analyzer 150 quantifies the intimacy between the user of the other device 200 and the user of the electronic device 100 (for example, data such as 1,2, 3, 10, etc. or grade 1, It can be calculated with the same data as grades 2 and 3). For example, the intimacy analyzer 150 may select which intimacy between the user of the counterpart device 200 and the user of the electronic device 100 is included in one or more predetermined categories. For example, the intimacy analyzer 150 selects one of categories such as 'family', 'friend', 'work' or 'school' for intimacy between the user of the other device 200 and the user of the electronic device 100 . can be analyzed in this way.

The friend list database 190 may store data analyzed by the relationship detector 140 and the intimacy analyzer 150 centered on the relationship between the electronic device 100 and the user.

In addition, in another embodiment of the present invention, at least one of the relationship detector 140 , the affinity analyzer 150 , and the friend list database 190 may be included in the server 300 .

[3. Scenario 2]

[3.1. Check whether the content has been acquired]

18 to 24 are diagrams for explaining a content providing method according to an embodiment of the present invention. 18 to 24 are diagrams illustrating a user interface step-by-step for a scenario in which an electronic device provides an image, a recommended application, and a direct answer as answer-related content to a user while providing a text chat service.

Referring to FIG. 18 , Chris, a user of the electronic device, is having a text chat with Hyunjin, a user of the other device.

The electronic device displays the name of the user of the electronic device through the user name box 40 . In another embodiment of the present invention, the electronic device may display the user of the counterpart device through the user name box 40 .

The electronic device receives the message 'Hi~!' (50) from Chris's counterpart at 8:26 on August 6, 2013. The electronic device transmits the message 51 to the counterpart device and receives the message 52 from the counterpart device. The user of the electronic device receives a message from Hyunjin saying 'Where are you?'.

The electronic device may determine whether each of the messages 50 , 51 , 52 , 53 is a question. For example, the electronic device may determine that each of the messages 50 , 51 , and 52 is not a question, and may determine that the message 53 is a question.

For example, the electronic device may mark a message determined to be a question to be distinguished from other messages, as shown in FIGS. 19A to 19C . For example, the electronic device may display a message corresponding to a question through an underline as shown in FIG. 19A . For example, as shown in FIG. 19B , the electronic device may display a message corresponding to a question by shading characters. For example, the electronic device may display a message corresponding to a question by displaying a shadow on the speech bubble as shown in FIG. 19C .

When the electronic device receives an input corresponding to a portion marked to be distinguished from other messages from the user, the electronic device may display content available for answering the message.

For example, when the electronic device determines that the message 53 is a question, as shown in FIG. 19D , the electronic device may receive confirmation from the user whether a recommendation response is required through the pop-up window 60 .

[3.2. Suggestion of content]

20A to 20D , the electronic device may display available contents when responding to a message 53 in response to a user input.

Referring to FIG. 20A , when the electronic device receives a user input (eg, a touch) corresponding to a mark as shown in FIG. 19C , an application related to a message corresponding to a question may be recommended. For example, the electronic device may recommend a map application or a navigation application when a message corresponding to a question is related to a location.

Referring to FIG. 20B , when the electronic device receives a user input corresponding to the display as shown in FIG. 19D (eg, an input for the user to touch a Yes button), the electronic device may recommend an application related to the message corresponding to the question. can For example, the electronic device may recommend a map application or a navigation application when a message corresponding to a question is related to a location.

Referring to FIG. 20C , when the electronic device receives a user input corresponding to the display as shown in FIG. 19D (eg, an input for the user to touch a Yes button), among applications and images related to a message corresponding to a question At least one can be recommended.

The electronic device may recommend at least one of an application and an image that can be used for a response in consideration of the relationship between the user of the electronic device and the user of the other device through the exemplary method described with reference to FIGS. 15 to 17 .

For example, when it is determined that the user of the electronic device and the user of the other device are in a relationship between the employer and the employee at work, the electronic device may recommend at least one of an application and an image, excluding a personal photo of the user of the electronic device. . For example, if the user of the electronic device is currently on vacation in London, the electronic device may not recommend a photo taken during vacation as an answer, considering that the relationship between the interlocutors is a business relationship.

Referring to FIG. 20D , when the electronic device receives a user input corresponding to the display as shown in FIG. 19D (eg, an input for the user to touch a Yes button), an application related to a message corresponding to a question, a direct answer and at least one of images.

The electronic device may recommend at least one of an application that can be used for a response, a direct answer, and an image in consideration of the relationship between the user of the electronic device and the user of the other device through the exemplary method described with reference to FIGS. 15 to 17 . . In the present specification, a direct answer may mean a sentence, phrase, or word that can be an answer to a message without any additional search.

For example, when the electronic device determines that the user of the electronic device and the user of the other device are in a family relationship or a close friend relationship, the electronic device may provide usable content in the answer including a personal photo of the user of the electronic device. have. For example, if the user of the electronic device is currently on vacation in London, the electronic device may recommend a picture taken while on vacation, considering that the relationship between the interlocutors is a personal relationship.

[3.3. Specific answer situation]

21 to 24 are diagrams illustrating that a user selects content related to an answer proposed by an electronic device and provides it to a counterpart device.

Referring to FIG. 21 , a user of the electronic device may select a map application from among contents related to a recommended answer as shown in FIG. 20D .

Referring to FIG. 22A , the electronic device may request the user to confirm whether to edit the content through the pop-up window 70 . For example, if the user wants to use the content provided by the application without separate editing, the user may select the answer that the content is not edited.

Referring to FIG. 22B , when the electronic device confirms that the user does not want to edit the selected content, the screen indicating the user's current location in the map app selected in FIG. 21 may be provided to the other device through a message without separate editing. have.

Referring to FIG. 23A , the electronic device may request the user to confirm whether to edit the content through the pop-up window 70 . For example, if the user wants to respond by editing content provided by the application, he or she may select an answer to edit the content.

Referring to FIG. 23B , when the electronic device determines that the user wants to edit the selected content, the electronic device searches for the user's current location in the map application selected in FIG. 21 so that the user edits the screen indicating the current location, and responds to the search result screen can be displayed.

Referring to FIG. 23C , the electronic device may transmit a screen in which the user edits the search result provided by the map application to the counterpart device through a message.

[3.4. Feedback Situation]

24A to 24E are diagrams illustrating a user interface for receiving feedback from a user on the provision of content usable for an answer according to an embodiment of the present invention.

Referring to FIG. 24A , through the pop-up window 80 , the electronic device may inquire as to whether the user was satisfied with the provision of content that can be used for an answer.

24B to 24D, when the user answers through the pop-up window 80 that the provision of content is not satisfactory to the user, the electronic device selects a category to be added or excluded from the provision of content that can be used for a later answer. Pop-up windows 81 , 82 , 83 , 84 , 85 may be provided for selection.

Referring to FIG. 24E , when the user replies that the provision of content is not satisfactory to the user through the pop-up window 80, the electronic device selects the environment setting desired to be changed in relation to the provision of content that can be used for a later answer. To do this, pop-up windows 86 and 87 may be provided.

[3.5. Suggested Answer Layout]

25A to 25E are diagrams illustrating a content providing screen when content available for an answer is provided according to an embodiment of the present invention.

Referring to FIG. 25A , an electronic device may provide content in a screen division method. The electronic device may display the recommended content list 90 , the recommended content list 91 , and the recommended application list 92 . For example, when the user touches the recommended content list 90 in the first scene (Scene #1), the electronic device switches to the second scene (Scene #2) and transfers the recommended content list 90 to the counterpart device. can be forwarded to For example, the electronic device may transmit the recommended content list 90 to the counterpart device through a message.

Referring to FIG. 25B , the electronic device may provide content in a screen switching method. The electronic device may display the summarized answer-related content 98 in the third scene (Scene #3) and display the detailed answer-related content 93 and 9 in the fourth scene (Scene #4). When the user touches or pans the third scene (Scene #3), the electronic device may display the fourth scene (Scene #4).

Referring to FIG. 25C , the electronic device may display an image, an application, and a possible direct answer. Although not shown, the electronic device may display content available for answers in various ways and in various arrangements.

Referring to FIG. 25D , the electronic device may provide content that can be used for an answer through the voice of the avatar.

Referring to FIG. 25E , when the electronic device is a smart watch, the electronic device may provide recommended content through the summary screen 97 . The electronic device may display another summary screen when the user touches or taps the move button 98 .

26 is a diagram illustrating that an electronic device provides an interface for changing a content providing layout.

Referring to FIG. 26 , the electronic device may receive user feedback on whether to change the content providing layout through the pop-up window 99 , and may select various content providing layouts according to the user's selection.

[4. Scenario 3]

[4.1. Check whether the content has been acquired]

27 to 37 are diagrams for explaining a content providing method according to an embodiment of the present invention. 27 to 37 are diagrams illustrating a user interface step-by-step for a scenario in which an electronic device provides an image, a recommended application, and a direct answer as answer-related content to a user while providing a voice chat service.

Referring to FIG. 27 , Chris, a user of an electronic device, is having a voice chat with Hyunjin, a user of a counterpart device. The electronic device and the counterpart device may classify each user's conversation in a message unit.

Referring to FIG. 28 , the electronic device may receive each voice message and convert the message to STT (Speech to Text) according to the illustrated order.

The electronic device may identify which language each voice message is composed of for each voice message (S4010). For example, for each voice message, the electronic device may identify whether each voice message is composed of English or Korean.

The electronic device may convert each voice message into text in the identified language (S4030). For example, when the electronic device determines that the first voice message is in English, the electronic device may convert the first voice message into English text.

The electronic device may display the converted text (S4050). For example, the electronic device may convert the first voice message into English text and display it through a display unit (or an output interface).

Referring to FIG. 29 , Chris' electronic device receives a message 55 'Where is he?' from Hyunjin's electronic device. The electronic device may determine whether each message is a question. For example, the electronic device may determine whether the message 55 is a question. The electronic device may determine who the 'he' included in the message 55 'Where is he?' refers to through natural language analysis.

[4.2. Receive user input]

Referring to FIG. 30 , when it is determined that the message is a question, the electronic device may receive confirmation from the user whether a recommendation response is required.

For example, when the electronic device determines that the message 55 'Where is he?' is a question, as shown in FIG. have. In response to the pop-up window 63 , when the user touches the 'yes' button to indicate that he wants to be provided with content that can be used for an answer, the electronic device may display various acquired content.

[4.3. Specific proposal situation]

Referring to FIG. 31 , the electronic device may provide images 74_a , 74_b , and 74_c , applications 75_a , 75_b , and 75_c , and a possible direct answer 76 .

Referring to FIG. 32 , a user may select an image 74_b from among contents available for an answer. The electronic device may receive a user's input. For example, the user's input may be a touch input for selecting the image 74_b.

Referring to FIG. 33 , the electronic device may check whether to edit the selected content through the pop-up window 64 . The user may touch the 'No' button to mean that the selected content will be used for the response without editing through the pop-up window 64 .

Referring to FIG. 34 , when the user confirms through the pop-up window 64 that the selected content will be used for the response without editing, the electronic device may transmit the image 74_b as a message 56 to the conversation partner.

Referring to FIG. 35 , the electronic device may check whether to edit the selected content through the pop-up window 64 . The user may touch the 'Yes' button to indicate that the user wants to edit the selected content through the pop-up window 64 and use it for the response.

Referring to FIG. 36 , when the user touches the 'Yes' button to indicate that the user wants to edit the selected content through the pop-up window 64 and use it for the response, the electronic device may provide the image editing environment 65 to the user. . The user may edit the image 74_b through the image editing environment 65 .

Referring to FIG. 37 , when the user finishes editing, the electronic device is a user of the electronic device, a user of the counterpart device, or a third The image 74_b may be provided to the user. In addition, the electronic device may provide the image 74_b to the user of the electronic device, the user of the counterpart device, or a third party through various services regardless of the user's selection.

[5. Scenario 4]

[5.1. Check whether the content has been acquired]

38 to 56 are diagrams for explaining a content providing method according to an embodiment of the present invention. 38 to 56 are diagrams illustrating a user interface step by step for a scenario in which an electronic device provides at least one of an image, a recommended application, and a possible direct answer as answer-related content to a user while providing a video call service.

Referring to FIG. 38 , Sunny, a user of the electronic device, is having a video call with John, a user of the other device. The electronic device may display the user of the electronic device and the user of the other device in real time. The electronic device may display the contents of a conversation between the user of the electronic device and the user of the counterpart device in real time. For example, the electronic device may display the content of conversations between users in real time in the form of speech bubbles through a Speech to Text (STT) function.

The electronic device receives a message 57 'Where are you?' from John's counterpart's device. The electronic device and the counterpart device can display the message exchanged through the STT (Speech to Text) function. The electronic device continuously transmits a message to the counterpart device and receives the message from the counterpart device. The electronic device may determine whether the continuously received message is a question. The user of the electronic device receives the message 'Where are you?' from John.

Referring to FIG. 39 , in the case where the electronic device determines that the message 57 is a question, the electronic device may receive confirmation from the user as to whether or not the provision of usable content is required at the time of answering through the pop-up window 65 .

[5.2. Suggestion of content]

Referring to FIGS. 40 to 42 , the electronic device may display contents available when responding to a message 57 in response to a user input.

Referring to FIG. 40 , when receiving the message 57 shown in FIG. 38 , the electronic device may recommend an application related to the message 57 . For example, the electronic device may recommend a map application or a navigation application when the content of the message relates to a location.

Referring to FIG. 41 , when the electronic device receives a user input corresponding to the display as shown in FIG. 39 (eg, an input for the user to touch a Yes button), an application related to the message 57 may be recommended. have. For example, the electronic device may recommend a map application or a navigation application when a message corresponding to a question is related to a location.

Referring to FIG. 42 , when the electronic device receives a user's input corresponding to the display as shown in FIG. 39 (eg, an input of the user touching a Yes button), the image related to the message 57, the application and the direct At least one of the answers can be recommended.

[5.3. Specific proposal situation (1)]

Referring to FIG. 43A , the electronic device may provide images when a user requests to provide usable content when answering.

Referring to FIG. 43B , in response to a message, the electronic device may provide images when a user desires to receive content without separately confirming that content that can be used when answering is provided.

Referring to FIG. 44 , a user may select an image 77_a from among contents available for an answer. The electronic device may receive a user input for selection. For example, the user's input may be a touch input for selecting the image 77_a.

The electronic device may provide the user with an answer editing window. The user may edit the selection image 77_b through the answer editing window.

Referring to FIG. 45 , when the user touches the edited image 77_b, the edited selected image 77_b may be provided to the conversation partner. For example, when the user touches the edited selection image 77_b, the electronic device may transmit the edited selection image 77_b to the conversation partner. The electronic device may deliver the edited selection image 77_b through a portion displaying the user's appearance.

Although not shown, when the user finishes editing, the electronic device is sent to the user of the electronic device, the user of the other device, or a third party through a mailing service or SNS (Social Network Service) according to the user's selection. An image 77_b may be provided. In addition, the electronic device may provide the image 77_b to the user of the electronic device, the user of the counterpart device, or a third party through various services regardless of the user's selection.

[5.4. Specific proposal situation (2)]

Referring to FIG. 46_a , the electronic device may provide an image, an application, and a possible direct answer when the user requests to provide usable content when answering.

Referring to FIG. 46B , in response to a message, the electronic device may provide an image, an application, and a possible direct answer without a separate confirmation for providing content that can be used when answering.

Referring to FIG. 47 , a user may select a map application 78_a from among contents available for an answer. The electronic device may receive a user's input. For example, the user's input may be a touch input for selecting the application 78_a.

The electronic device may provide an answer editing window to the user in response to the user's input. The electronic device may input the keyword extracted from the message to the application 78_a as an input value and display the generated result through the answer editing window. For example, the electronic device may display the result image 78_b generated by inputting 'current location' as a keyword in the map application through the answer editing window, as shown in the figure.

The electronic device may provide an editing environment through the answer editing window so that the user can edit the result image 78_b. For example, the user may enlarge or reduce the result image 78_b through the answer editing window, and may select a part of the result image 78_b.

Referring to FIG. 48 , when a user selects an edited result image 78_b, the result image 78_b may be provided to a conversation partner. For example, when the user touches the edited result image 78_b, the electronic device may deliver the edited result image 78_b to the conversation partner. The electronic device may deliver the edited result image 78_b through the portion displaying the user's appearance.

[6. Scenario 5]

49 to 53 are diagrams for comprehensively explaining a content providing method according to an embodiment of the present invention. 49 to 53 show that, while the electronic device 100 and the counterpart device 200 provide a text message service, a possible direct answer, a restaurant application, an answer-related image, a map application, and a news application are recommended as answer-related content to the user. It is a diagram showing a user interface step by step for a scenario to be performed.

[6.1. Direct Answer Suggestion]

49(a) and 49(b) , John, a user of the electronic device 100, is having a conversation with Mike, a user of the counterpart device 200, using a text message service. John receives a message (111) from Mike saying 'Where will you go afternoon?'. The electronic device 100 and the counterpart device 200 may display messages sent and received. The electronic device 100 may determine whether the continuously received message is a question.

Referring to FIG. 49( a ), when determining that the message 111 is a question, the electronic device 100 may provide direct answer candidates 111_a , 111_b , and 111_c to the user. The user John may click one direct answer candidate 111_b to transmit it to the other party Mike.

49( c ) and 49 ( d ) , John and Mike can check messages 111 , 112 , 211 and 212 exchanged between devices.

[6.2. Suggestion of restaurant through restaurant application]

50(a) and 50(b), Mike asks John, “Really? I was there for one month.” message 213 can be delivered. The electronic device 100 may display the message 113 received from the counterpart device 200 . John may forward message 114 to Mike "Do you know a good restaurant near the Fenway park?" The counterpart device 200 may display the message 214 received from the electronic device 100 .

50(c) and 50(d) , the counterpart device 200 may recommend various restaurant-related applications 214_a in response to the received message, and may recommend menu contents. By touching the menu contents, Mike can send a message 115 containing the menu contents to John.

[6.3. Suggest answers through images]

51 ( a ) and 51 ( b ), John, a user of the electronic device 100 , delivers a message 116 saying “Do you have a picture?” to Mike, a user of the counterpart device 200 . can do. The counterpart device 200 may display the message 216 received from John.

51(c) and 51(d) , the counterpart device 200 may recommend an image 216_a in response to the received message. By touching the image of the recommended food, Mike can send John a message 118 with the menu content.

[6.4. Send your location through the map application]

52(a) and 52(b) , Mike may transmit a message 219 to John saying “Where do you depart from?”. The electronic device 100 may display the message 119 received from Mike.

52( c ) and 52 ( d ) , the electronic device 100 may recommend a map application 119_a in response to the received message 119 . John can send his location to Mike in a message 220 through the recommended map application.

[6.5. Article transmission through news application]

53(a) and 53(b) , John may transmit a message 121 to Mike saying “Is there a hot issue in Boston?”.

53(c), 53(d1), and 53(d2), the counterpart device 200 may display a message 221 received from Mike. The counterpart device 200 may recommend the news application 221_a in response to the received message 221 . When Mike selects the recommended news application, the counterpart device 200 can display a news article through screen switching as shown in FIG. 100) can be transmitted. The electronic device 100 may display a message 122 including a link of a related article and an article summary screen.

[7. Scenario 6]

54(a) to 54(d) are diagrams for explaining a content providing method according to an embodiment of the present invention. 54 is a diagram illustrating a user interface step-by-step for a scenario in which the electronic device 100 and the counterpart device 200 provide a text message service during a voice call and recommend an answer through a map application with answer-related content to the user to be.

Referring to FIG. 54A , the electronic device 100 may receive a voice message 131 saying “where is the accident point?” during a voice call. Referring to FIG. 54(b) , the electronic device may check whether the user wants a recommendation response through the pop-up screen 132 . Referring to FIG. 54(c) , the user of the electronic device 100 may select a map application through a touch. Referring to FIG. 54(d) , the counterpart device 200 may receive a message 232 indicating the location of the user of the electronic device 100 from the electronic device 100 .

[8. Scenario 7]

55(a) to 55(d) are diagrams for explaining a content providing method according to an embodiment of the present invention. 55(a) to 55(d) are step-by-step for a scenario in which the electronic device 100 and the counterpart device 200 provide a text message service and recommend different candidates as answers as answer-related content to the user. is a diagram showing a user interface.

Referring to Figure 55 (a), John can receive a message 141 "where will you go afternoon?" from the boss. In this regard, the electronic device 100 is [13:00 Launch Meeting] (141_a) , [15:00 Business Trip] (141_b) and [18:00 Conference Meeting] (141_c), such as direct answers and related applications (141_d) can be proposed.

Referring to FIG. 55( b ), John may receive a message 151 saying “Where will you go afternoon?” from a friend. In this regard, the electronic device 100 provides direct answers and related applications ( 151_d) can be proposed.

55(a) and 55(b) , when the same question is received from the same electronic device, different answers may be recommended according to the relationship of the conversation partner with the user. For example, when receiving the message 141 from the boss, the electronic device 100 may recommend [15:00 Business Trip] (141_b), and when receiving the message 151 from a friend, [15] :00 Business Trip](141_b) is not recommended, but [14:00 Coffee Time with Peter](151_b).

Referring to Fig. 55(c), John may receive a message 142 from the salesperson saying "How about buying a nice car?" Direct answers such as [buy a car] (142_a) and [Never call me] (142_b) and related applications 142_c may be recommended.

Referring to FIG. 55( d ) , John may receive a message 152 , “How about buying a nice car?” from a friend. In this regard, the electronic device 100 may suggest direct answers and related applications 151_c such as [If you give me it, I'll be so happy] (151_a) and [I dream it every day] (152_b). have.

55(a) and 55(b) , when the same question is received from the same electronic device, different answers may be recommended according to the relationship of the conversation partner with the user. For example, the electronic device 100 may recommend [Never call me] (142_b) when receiving the message 142 from the salesperson, and when receiving the message 152 from a friend, [I dream it every day.](152_b) can be recommended.

[9. Composition of Electronic Devices]

56 is a block diagram illustrating a configuration of a user terminal device according to an embodiment of the present disclosure, and the user terminal device 1000 shown in FIG. 49 may be the electronic device 100 of FIG. 1 .

Referring to FIG. 56 , the user terminal device 1000 includes a display unit 1100 , a control unit 1700 , a memory 1200 , a GPS chip 1250 , a communication unit 1300 , a video processor 1350 , and an audio processor 1400 . , a user input unit 1450 , a microphone unit 1500 , an imaging unit 1550 , a speaker unit 1600 , and at least one of a motion sensing unit 1650 .

The display unit 1100 may include a display panel 1110 and a controller (not shown) for controlling the display panel 1110 . The display panel 1110 includes various types of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active-matrix organic light-emitting diode (AM-OLED), and a plasma display panel (PDP). can be The display panel 1110 may be implemented to be flexible, transparent, or wearable. The display unit 1100 may be coupled to the touch panel 1470 of the user input unit 1450 and provided as a touch screen (not shown). For example, the touch screen (not shown) may include an integrated module in which the display panel 1110 and the touch panel 1470 are coupled in a stacked structure. The memory 1200 may include at least one of an internal memory (not shown) and an external memory (not shown).

The built-in memory includes, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), a non-volatile memory (eg, One Time Programmable ROM (OTPROM)). ), Programmable ROM (PROM), Erasable and Programmable ROM (EPROM), Electrically Erasable and Programmable ROM (EEPROM), Mask ROM, Flash ROM, etc.), hard disk drive (HDD), or solid state drive (SSD). may include According to an embodiment, the controller 1700 may load a command or data received from at least one of the non-volatile memory or other components into the volatile memory and process it. Also, the controller 1700 may store data received or generated from other components in a non-volatile memory.

The external memory includes, for example, at least one of CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD (extreme Digital), and Memory Stick. may include

The memory 1200 may store various programs and data used for the operation of the user terminal device 1000 . For example, the memory 1200 may temporarily or semi-permanently store at least a portion of content to be displayed on the lock screen.

The controller 1700 may control the display unit 1100 so that a part of the content stored in the memory 1200 is displayed on the display unit 1100 . In other words, the controller 1700 may display a part of the content stored in the memory 1200 on the display unit 1100 . Alternatively, when a user gesture is made in one area of the display unit 11000 , the controller 1700 may perform a control operation corresponding to the user's gesture.

The controller 1700 may include at least one of a RAM 1710 , a ROM 1720 , a CPU 1730 , a graphic processing unit (GPU) 1740 , and a bus 1750 . The RAM 1710 , the ROM 1720 , the CPU 1730 , and the GPU 1740 may be connected to each other through the bus 1750 .

The CPU 1730 accesses the memory 1200 and performs booting using the O/S stored in the memory 1200 . Then, various operations are performed using various programs, contents, data, etc. stored in the memory 1200 .

The ROM 1720 stores an instruction set for system booting, and the like. For example, in the mobile terminal 1000, when a turn-on command is input and power is supplied, the CPU 1730 copies the O/S stored in the memory 1200 according to the command stored in the ROM 1720 to the RAM 1710, You can boot the system by executing O/S. When booting is completed, the CPU 1730 copies various programs stored in the memory 1200 to the RAM 1710 and executes the programs copied to the RAM 1710 to perform various operations. When the booting of the user terminal device 1000 is completed, the GPU 1740 displays a UI screen on the area of the display unit 1100 . Specifically, the GPU 1740 may generate a screen on which an electronic document including various objects such as content, icons, and menus is displayed. The GPU 1740 calculates property values such as coordinate values, shape, size, color, etc., at which each object is to be displayed according to the layout of the screen. Also, the GPU 1740 may generate screens of various layouts including objects based on the calculated attribute values. The screen generated by the GPU 1740 may be provided to the display unit 1100 and displayed on each area of the display unit 1100 .

The GPS chip 1250 may receive a GPS signal from a Global Positioning System (GPS) satellite and calculate the current location of the user terminal device 1000 . The controller 1700 may calculate the user's location by using the GPS chip 1250 when using a navigation program or when the user's current location is required otherwise.

The communication unit 1300 may perform communication with various types of counterpart devices according to various types of communication methods. The communication unit 130 may include at least one of a Wi-Fi chip 1310 , a Bluetooth chip 1320 , a wireless communication chip 1330 , and an NFC chip 1340 . The control unit 1700 may communicate with various counterpart devices using the communication unit 1300 .

The Wi-Fi chip 1310 and the Bluetooth chip 1320 may perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 1310 or the Bluetooth chip 1320, various connected contents such as an SSID and a session key are first transmitted and received, and then various contents can be transmitted and received after communication connection using the same. The wireless communication chip 1330 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evoloution (LTE). The NFC chip 134 refers to a chip operating in a Near Field Communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz.

The video processor 1350 may process video data included in content received through the communication unit 1300 or content stored in the memory 1200 . The video processor 1350 may perform various image processing, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like, on video data.

The audio processor 1400 may process audio data included in content received through the communication unit 1300 or content stored in the memory 1200 . The audio processor 1400 may perform various processes such as decoding, amplification, and noise filtering on audio data.

When a playback program for multimedia content is executed, the controller 1700 drives the video processor 1350 and the audio processor 1400 to play the corresponding content. The speaker unit 1600 may output audio data generated by the audio processor 1400 .

The user input unit 1450 may receive various commands from the user. The user input unit 1450 may include at least one of a key 1460 , a touch panel 1470 , and a pen recognition panel 1480 .

The key 1460 may include various types of keys, such as mechanical buttons and wheels, which are formed in various areas such as the front, side, and rear of the main body of the user terminal device 1000 .

The touch panel 1470 may detect a user's touch input and output a touch event value corresponding to the sensed touch signal. When the touch panel 1470 is combined with the display panel 1110 to form a touch screen (not shown), the touch screen may be implemented with various types of touch sensors such as capacitive type, pressure sensitive type, and piezoelectric type. The capacitive type is a method of calculating touch coordinates by sensing micro-electricity generated by the user's body when a part of the user's body is touched on the touch screen surface using a dielectric coated on the touch screen surface. The decompression type includes two electrode plates built into the touch screen, and when the user touches the screen, the touch coordinates are calculated by detecting that the upper and lower plates of the touched point come into contact and current flows. A touch event occurring on a touch screen may be mainly generated by a human finger, but may also be generated by an object made of a conductive material capable of applying a change in capacitance.

The pen recognition panel 1480 detects a pen proximity input or touch input according to the operation of a user's touch pen (eg, a stylus pen, a digitizer pen), and detects a detected pen proximity event or pen. A touch event can be output. The pen recognition panel 1480 may be implemented by, for example, an EMR method, and may detect a touch or proximity input according to the proximity of the pen or a change in the intensity of an electromagnetic field due to the touch. In detail, the pen recognition panel 1480 includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processing unit (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor. ) may be included. When a pen having a built-in resonance circuit is present in the vicinity of the loop coil of the pen recognition panel 1480, a magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonance circuit in the pen. Based on this current, an induced magnetic field is generated from the coil constituting the resonance circuit in the pen, and the pen recognition panel 1480 detects the induced magnetic field from the loop coil in the signal receiving state, so that the pen approaching position or A touch position may be sensed. The pen recognition panel 1480 may be provided with a predetermined area under the display panel 1110 , for example, an area capable of covering the display area of the display panel 1110 .

The microphone unit 1500 may receive a user's voice or other sound and convert it into audio data. The control unit 1700 may use the user's voice input through the microphone unit 1500 in a call operation or convert it into audio data and store it in the memory 1200 .

The imaging unit 1550 may capture a still image or a moving image according to the user's control. The imaging unit 1550 may be implemented in plurality, such as a front camera or a rear camera.

When the imaging unit 1550 and the microphone unit 1500 are provided, the control unit 1700 performs a control operation according to a user voice input through the microphone unit 150 or a user motion recognized by the imaging unit 1550 . may be For example, the user terminal device 100 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the controller 1700 may activate the imaging unit 1550 to capture an image of a user, track a change in the user's motion, and perform a corresponding control operation. When operating in the voice control mode, the controller 1700 may operate in a voice recognition mode in which a user voice input through the microphone unit 1500 is analyzed and a control operation is performed according to the analyzed user voice.

The motion detection unit 1650 may detect a movement of the body of the user terminal device 1000 . The user terminal device 1000 may be rotated or tilted in various directions. In this case, the motion detection unit 1650 may detect motion characteristics such as a rotation direction, an angle, and a tilt using at least one of various sensors such as a geomagnetic sensor, a gyro sensor, and an acceleration sensor.

In addition, a USB port to which a USB connector can be connected in the user terminal device 1000, various external input ports for connection with various external terminals such as a headset, a mouse, and a LAN, and a Digital Multimedia Broadcasting (DMB) signal are received and processed It may further include a DMB chip, various sensors, and the like.

Names of components of the aforementioned user terminal device 1000 may be different. Also, the user terminal device 1000 according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or may further include additional other components.

57 is a block diagram illustrating a software configuration of the user terminal device 1000 according to an embodiment of the present disclosure.

Referring to FIG. 57 , the memory 1200 may store an operating system that controls resources of the user terminal device 1000 and an application program for operating an application. The operating system may include a kernel, middleware, API, and the like. The operating system may include, for example, Android, iOS, Windows, Symbian, Tizen, or Bada operating systems.

The kernel 1210 may include at least one of a device driver 1210 - 1 and a system resource manager 1210 - 2 capable of managing resources. The device driver 1210-1 may control hardware of the user terminal apparatus 1000 by software access. To this end, the device driver 1210-1 may be divided into an interface and an individual driver module provided by each hardware company. The device driver 1210-1 may include, for example, at least one of a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, and an inter-process communication (IPC) driver. can The system resource manager 1210 - 2 may include at least one of a process manager, a memory manager, and a file system manager. The system resource manager 1210 - 2 may perform functions such as controlling, allocating, or recovering system resources.

The middleware 1220 may include a plurality of modules implemented in advance to provide functions commonly required in various applications. The middleware 1220 may provide a function through the API 1230 so that the application 1240 can efficiently use the resources inside the user terminal device. The middleware 1220 includes, for example, an application manager 1220-1, a window manager 1220-2, a multimedia manager 1220-3, a resource manager 1220-4, a power manager 1220-5, and a database manager. 1220-6, package manager 1220-7, connection manager 1220-8, notification manager 1220-9, location manager 1220-10, graphics manager 1220-11, or security manager 1220 -12) may include at least one or more of a plurality of modules.

The application manager 1220 - 1 may manage a life cycle of at least one application among the applications 1240 . The window manager 1220 - 2 may manage GUI resources used in the screen. The multimedia manager 1220-3 may recognize a format for playing various media files, and may encode or decode the media files using a codec suitable for the format. The resource manager 1220 - 4 may manage resources such as a source code, a memory, or a storage space of at least one of the applications 1240 . The power manager 1220 - 5 may operate together with a BIOS, etc. to manage a battery or power, and may provide power information and the like for operation. The database manager 1220 - 6 may manage to create, search, or change a database to be used by at least one of the applications 1240 . The package manager 1220 - 7 may manage installation or update of applications distributed in the form of package files. The connection manager 1220 - 8 may manage a wireless connection such as WiFi or Bluetooth, for example. The notification manager 122 - 9 may display or notify an event such as an arrival message, an appointment, or a proximity notification in an unobtrusive manner to the user. The location manager 1220 - 10 may manage location information of the user terminal device 1000 . The graphic manager 1220-11 may manage graphic effects to be provided to the user and a user interface related thereto. The security manager 1220-12 may provide various security functions required for system security or user authentication. When the user user terminal device 1000 has a phone function, the middleware 1220 may further include a call manager (not shown) for managing the user's voice or video call function.

The middleware 1220 may further include a runtime library 1220-13 or other library modules (not shown). The runtime library 1220-13 is a library module used by the compiler to add a new function through a programming language while an application is being executed. For example, the runtime library 1220-13 may perform functions for input/output, memory management, or arithmetic functions. The middleware 1220 may generate and use a new middleware module through various function combinations of the aforementioned internal component modules. The middleware 1220 may provide a module specialized for each type of operating system in order to provide a differentiated function. The middleware 1220 may dynamically delete some existing components or add new components. Some of the components described in the embodiment of the present disclosure may be omitted, may further include other components, or may be replaced with components having other names that perform similar functions.

The API 1230 is a set of API programming functions and may be provided in a different configuration according to an operating system. In the case of Android or iOS, for example, one API set may be provided for each platform, and in the case of Tizen, for example, two or more API sets may be provided.

The application 1240 may include a preloaded application installed by default or a third party application that a user can install and use during a use process. The application 1240 includes, for example, a home application 1240-1 for returning to the home screen, a dialer application 1240-2 capable of making a phone call with a counterpart, and a counterpart identified by a phone number. Text message application for receiving messages (1240-3), IM (Instant Message) application (1240-4), browser (Browser) application (1240-5), camera application (1240-6), alarm application (1240-7) ), a phone-book application (1240-8) that manages the other party's phone number or address, a call log application ( 1240-9), an email application (1240-10) that receives a message from a counterpart identified by an email (E-mail), a calendar application (1240-11), a media player application (1240-12), an album At least one of an application 1240-13 and a watch application 1240-14 may be included. The names of the aforementioned components of the software according to the present disclosure may vary depending on the type of the operating system. In addition, the software according to the present disclosure may include at least one or more of the above-described components, some may be omitted, or may further include additional other components.

58 is a diagram illustrating a user interface (UI) of an electronic device 2000 for explaining an embodiment of the present invention. The electronic device 2000 may be the electronic device 100 of FIG. 1 .

The electronic device 2000 may include a processor 2700 , an input interface 2400 , and an output interface 2100 .

Processor The processor 2700 may include a mobile application processor or a central processor unit. The processor may be expressed as a controller, a control unit, or the like. In addition, the processor may be used in the sense of including a core, a display controller, and an image signal processor (ISP).

The processor 2700 according to an embodiment of the present invention may extract at least one keyword from a message displayed on a screen through a message service. In addition, the processor 2700 according to an embodiment of the present invention may newly generate a keyword related to the keyword. In addition, the processor 2700 according to an embodiment of the present invention may acquire content based on a newly created keyword and location information of the electronic device.

The input interface 2400 may mean a means for a user to input data for controlling the electronic device 100 . For example, the input interface 2400 may include a key pad, a dome switch, and a touch pad (contact capacitive method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral type). Tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, etc. may be configured. In addition, the input interface may include a touch screen, a touch panel, a microphone, and a keyboard.

Also, the input interface 2400 may include at least one module for receiving data from a user. For example, the input interface 2400 may include a motion recognition module, a touch recognition module, a voice recognition module, and the like.

The touch recognition module may detect a touch gesture on the user's touch screen and deliver content related to the touch gesture to the processor. The voice recognition module may recognize the user's voice using the voice recognition engine and transmit the recognized voice to the processor. The motion recognition module may recognize a movement of an object and transmit content related to the movement of the object to the processor.

Throughout the specification, the 'input' that the user makes through the input interface 2400 of the electronic device 2000 may include at least one of a touch input, a bending input, a voice input, a key input, and a multimodal input, However, the present invention is not limited thereto.

“Touch input” refers to a gesture, etc., performed by a user on a touch screen to control the electronic device 100 . For example, the touch input described herein may include a tap, a touch & hold, a double tap, a drag, a panning, a flick, a drag and drop, and the like.

A “tap” refers to an action of a user touching a screen using a finger or a touch tool (eg, an electronic pen) and immediately lifting it off the screen without moving.

“Touch & hold” refers to an operation in which a user touches a screen using a finger or a touch tool (eg, an electronic pen) and then maintains a touch input for a threshold time (eg, 2 seconds) or longer. For example, it means a case in which the time difference between the touch-in time and the touch-out time is equal to or greater than a threshold time (eg, 2 seconds). In order to make the user recognize whether the touch input is a tap or a touch & hold, if the touch input is maintained for a threshold time or longer, a feedback signal may be provided visually, aurally, or tactilely. The threshold time may be changed according to an implementation example.

"Double tap" refers to an operation in which a user taps the screen twice using a finger or a touch tool (stylus).

“Drag” refers to an operation in which a user touches a finger or a touch tool on the screen and then moves the finger or the touch tool to another location within the screen while maintaining the touch. Due to the drag operation, the object is moved or a panning operation, which will be described later, is performed.

“Panning” refers to a case in which a user performs a drag operation without selecting an object. Because panning does not select a specific object, the page itself moves within the screen rather than the object moving within the page, or a group of objects moves within the page.

A "flick" refers to an action in which a user drags with a finger or a touch tool at a threshold speed (eg, 100 pixel/s) or more. Drag (or panning) and flick may be distinguished based on whether the movement speed of the finger or the touch tool is equal to or greater than a threshold speed (eg, 100 pixel/s).

“Drag & drop” refers to an action in which a user drags an object to a predetermined position on the screen using a finger or a touch tool and then drops the object.

"Pinch" refers to a motion of moving in different directions while the user touches two fingers on the screen. It is a gesture to enlarge (Pinch Open) or Reduce (Pinch Close) an object or page, and the enlargement or reduction value is determined according to the distance between two fingers.

A “swipe” is an operation of moving a predetermined distance in a horizontal or vertical direction while touching an object on the screen with a finger or a touch tool. A movement in the diagonal direction may not be recognized as a swipe event.

“Motion input” refers to a motion that a user applies to the electronic device 100 to control the electronic device 100 . For example, the motion input may include an input in which a user rotates the electronic device 100 , tilts the electronic device 100 , or moves the electronic device 2000 up, down, left and right. The electronic device 2000 receives a motion input preset by the user using an acceleration sensor, a tilt sensor, a gyro sensor, a magnetic field sensor, and the like. can detect

Throughout the specification, when the electronic device 100 is a flexible display device, the term “bending input” refers to an input in which a user bends all or a portion of the electronic device 2000 in order to control the electronic device 2000 . According to an embodiment of the present invention, the electronic device 2000 uses a bending sensor, such as a bending position (coordinate value), a bending direction, a bending angle, a bending speed, the number of times of bending, a time of occurrence of a bending operation, a bending operation maintenance time, etc. can detect

Throughout the specification, when the electronic device 100 is a flexible display device, the term “bending input” refers to an input in which a user bends all or a portion of the electronic device 2000 in order to control the electronic device 2000 . According to an embodiment of the present invention, the electronic device 2000 uses a bending sensor, such as a bending position (coordinate value), a bending direction, a bending angle, a bending speed, the number of times of bending, a time of occurrence of a bending operation, a bending operation maintenance time, etc. can detect

Throughout the specification, “key input” refers to an input for controlling the electronic device 2000 by a user using a physical key attached to the electronic device 2000 or a virtual key provided by the electronic device 2000 .

The output interface is for outputting an audio signal, a video signal, or an alarm signal, and the output interface may include a display module, a sound output module, and the like. Also, the output interface may include a flat panel display capable of displaying a 2D image and a flat panel display capable of displaying a 3D image. The output interface may include a device capable of outputting a 3D hologram.

The electronic device 2000 may transmit and receive information through communication with the search server. For example, the electronic device 2000 may communicate with the search server through at least one protocol. For example, the electronic device 2000 includes Trivial File Transfer Protocol (TFTP), Simple Network Management Protocol (SNMP), Simple Mail Transfer Protocol (SMTP), Post Office Protocol (POP), Internet Control Message Protocol (ICMP), SLIP. (Serial Line Interface Protocol), Point to Point Protocol (PPP), Dynamic Host Control Protocol (DHCP), Network Basic Input Output System (NETBIOS), Internetwork Packet eXcharge (IPX/SPX), Internet Control Manage Protocol (ICMP), IP (Internet Protocol), ARP (Address Resolusion Protocol), TCP (Transmission Control Protocol), UDP (User Datagram Protocol), winsock, DHCP (Dynamic Host Configuration Protocol), RIP (Routing Information Protocol), and at least one protocol of NetBIOS It may communicate with the search server through, but is not limited thereto.

The electronic device 2000 may perform short-range communication through the short-range communication module. Short-distance communication technologies may include wireless LAN (Wi-Fi), Bluetooth, Zigbee, WFD (Wi-Fi Direct), UWB (ultra wideband), infrared data association (IrDA), etc. not.

A person of ordinary skill in the art related to the embodiments of the present invention will understand that it may be implemented in a modified form within a range that does not deviate from the essential characteristics of the above description. Therefore, the disclosed methods are to be considered in an illustrative and not a restrictive sense. The scope of the present invention is indicated in the claims rather than in the detailed description of the invention, and all differences within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (16)

A server for providing content related to a message to an electronic device, the server comprising:
a memory storing instructions; and
By executing the above commands:
Obtaining information about messages exchanged between the electronic device and another electronic device through a message application installed in the electronic device,
Analyze the meaning of the messages based on the information about the messages,
By analyzing the meaning of the messages, it identifies a message including a keyword related to food among the messages,
As the message is identified, information on at least one recommended content related to a restaurant corresponding to the location information of the electronic device is received from an external server that provides a search service,
Information on at least one recommended content related to the restaurant is provided through the message application installed in the electronic device so that the electronic device shares information on at least one recommended content related to the restaurant with the other electronic device which, processor;
including, the server. The method of claim 1,
The processor is configured to perform natural language interpretation of the messages between the electronic device and the other electronic device to analyze the meaning of the messages between the electronic device and the other electronic device. The method of claim 1,
The processor, in response to identifying the message, outputs a GUI for inquiring the user whether to display the recommended content through the message application. 4. The method of claim 3,
In response to receiving a user input requesting display of the recommended content through the GUI, the processor transmits a request for at least one recommended content related to a restaurant corresponding to the location information of the electronic device to the external server , server. The method of claim 1,
The processor, by identifying the message including the keyword related to the food, to obtain the location information of the electronic device from the electronic device, server. 6. The method of claim 5,
The processor is configured to transmit the location information of the electronic device to the external server. The method of claim 1,
The information on at least one recommended content related to a restaurant corresponding to the location information of the electronic device includes information about a plurality of restaurants located within a predetermined distance from the location of the electronic device. delete The method of claim 1,
The messages are received by the electronic device from the other electronic device,
The at least one recommended content related to the restaurant is at least one recommended content for responding to the messages, the server. The server of claim 1 , wherein the at least one recommended content related to the restaurant includes at least one of a plurality of restaurant images and a plurality of restaurant application icons. The method of claim 1,
The processor further identifies a message including a keyword related to weather by analyzing the meaning of the messages,
By identifying the message including the keyword related to the weather, weather information corresponding to the location information of the electronic device is obtained from an external weather server,
A server that provides the weather information through the message application installed in the electronic device so that the electronic device shares the weather information with the other electronic device. In an electronic device,
display;
a memory storing instructions; and
By executing the above commands:
Through the display, a screen of a message application is output, wherein the screen includes messages exchanged between the electronic device and another electronic device through the message application, and is inputted by a user for transmission to the other electronic device. Outputs the input part to receive the input message,
Control to transmit information of the messages displayed on the screen to the server,
As a message including a keyword related to food is identified among the messages, information on at least one recommended content related to a restaurant corresponding to the location information of the electronic device is received from the server,
Control to output at least one recommended content related to the restaurant to the input portion of the screen through the display so as to be selectable by the user,
a processor for controlling to transmit a message including the selected recommended content to the other electronic device based on selection of recommended content from among at least one recommended content related to the restaurant output through the display;
An electronic device comprising: A method for a server to provide content related to a message to an electronic device, the method comprising:
obtaining information about messages exchanged between the electronic device and another electronic device through a message application installed in the electronic device;
analyzing the meaning of the messages based on the information on the messages;
identifying a message including a keyword related to food from among the messages by analyzing the meaning of the messages;
receiving information on at least one recommended content related to a restaurant corresponding to the location information of the electronic device from an external server providing a search service according to the identification of the message; and
Information on at least one recommended content related to the restaurant is provided through the message application installed in the electronic device so that the electronic device shares information on at least one recommended content related to the restaurant with the other electronic device action to do;
A method comprising A method for an electronic device to provide content related to a message, the method comprising:
Through the display of the electronic device, output a screen of a message application, wherein the screen includes messages exchanged between the electronic device and another electronic device through the message application, and provides a message to the user for transmission to the other electronic device. outputting the input part to receive the input message input by the
transmitting information of messages displayed on the screen to a server;
receiving, from the server, information on at least one recommended content related to a restaurant corresponding to the location information of the electronic device when a message including a keyword related to food is identified from among the messages;
outputting at least one recommended content related to the restaurant to the input portion of the screen through the display so as to be selectable by the user; and
transmitting a message including the selected recommended content to the other electronic device based on selection of recommended content from among at least one recommended content related to the restaurant output through the display;
A method comprising A computer-readable recording medium recording a program for executing the method of claim 13 on a computer. A computer-readable recording medium recording a program for executing the method of claim 14 on a computer.

Images