CN112585911A

CN112585911A - Electronic device and control method thereof

Info

Publication number: CN112585911A
Application number: CN201980054715.6A
Authority: CN
Inventors: 金秀必; 崔源宗; 咸珍雅
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2018-08-20
Filing date: 2019-08-20
Publication date: 2021-03-30
Anticipated expiration: 2039-08-20
Also published as: CN112585911B; KR20200021402A

Abstract

A method of controlling an electronic device is provided. The method comprises the following steps: while using an electronic device to chat with a user of another electronic device, obtaining a name referring to the user of the other electronic device in a chat with the user of the other electronic device using an Artificial Intelligence (AI) model trained by an AI algorithm; and storing the obtained name in association with contact information of a user of another electronic device. At least some of the control methods of the present disclosure may use AI models trained according to machine learning, neural networks, or deep learning algorithms.

Description

Electronic device and control method thereof

Technical Field

The present disclosure relates to an electronic device and a control method thereof, and for example, to an electronic device and a control method thereof capable of obtaining meaningful information in a chat with a counterpart and using the information in various functions.

The present disclosure also relates to Artificial Intelligence (AI) systems that provide human-level intelligence, such as recognition and judgment using machine learning algorithms, and applications of AI systems.

Background

Recently, Artificial Intelligence (AI) systems that implement human-level intelligence have been used in various fields. Unlike existing rule-based intelligent systems, AI systems are systems that train themselves autonomously, make decisions, and become increasingly intelligent. The more the AI system is used, the more the recognition rate of the AI system can be improved and the more accurate the AI system can understand the user preferences, and thus, the existing rule-based intelligent system is gradually being replaced with the deep learning based AI system.

AI techniques refer to machine learning (deep learning) and element techniques that utilize machine learning.

Machine learning may be an algorithmic technique that autonomously classifies/learns characteristics of input data. The element technology may be a technology that simulates functions such as recognition and judgment of the human brain by using a machine learning algorithm such as deep learning, and relates to technical fields such as language understanding, visual understanding, inference/prediction, knowledge expression, motion control, and the like.

The AI technique can be applied to various fields as follows. Language understanding may refer to techniques for recognizing and applying/processing human languages/characters and include natural language processing, machine translation, dialog systems, question answering, language recognition/synthesis, and so forth. Visual understanding may refer to techniques of identifying and processing objects such as human vision, including object recognition, object tracking, image search, human recognition, scene understanding, spatial understanding, image enhancement, and the like. Inference prediction may refer to techniques for obtaining and logically inferring and predicting information, and includes knowledge/probabilistic-based reasoning, optimization prediction, preference-based planning and recommendation, and so forth. Knowledge representation may refer to techniques for automating human experience information into knowledge data, including knowledge construction (data generation/classification) and knowledge management (data utilization), among others. The motion control may refer to a technique of controlling the automatic driving of a vehicle and the motion of a robot, and includes motion control (navigation, collision avoidance, and driving), operation control (behavior control), and the like.

Recently, a voice-based AI personal assistant platform has been provided on electronic devices for the purpose of effectively managing information and various user experiences. The electronic device may support a natural and interactive interface with the user through the personal assistant platform.

For example, when the user refers to the name of a specific counterpart when requesting to make a call, the AI personal assistant of the electronic device may find a phone number corresponding to the name of the counterpart from previously stored contact information and connect the user with the counterpart. However, in order to use this function, the user must correctly remember the stored name of the partner. When the user attempts to contact a name different from the stored name of the counterpart, a problem of contact failure occurs.

Disclosure of Invention

Technical problem

Embodiments of the present disclosure provide an electronic device and a control method thereof capable of obtaining meaningful information in chatting with a counterpart and using the information in various functions.

Technical scheme

According to an exemplary embodiment of the present disclosure, a control method of an electronic device includes: while using an electronic device to chat with a user of another electronic device, obtaining a name referring to the user of the other electronic device in a chat with the other electronic device using an Artificial Intelligence (AI) model trained by an AI algorithm; and storing the obtained name in association with contact information of a user of another electronic device.

The control method may further include: based on the user's voice for making a call including the obtained name being input, a call connection is performed based on contact information of the user of the other electronic device.

Obtaining the name may include: based on a first name referring to a user of another electronic device previously registered in contact information of the user of the another electronic device, a second name different from the first name is obtained in a chat with the user of the another electronic device using the AI model.

The control method may further include: based on the user's voice for making a call including the second name being input, a message User Interface (UI) is provided which inquires whether to perform a call connection to the counterpart of the first name.

The control method may further include: based on receiving a user input for viewing contact information of a user of another electronic device, a contact information UI is provided that includes a phone number, a first name, and a second name of the user of the other electronic device.

The control method may further include: providing a chat UI for chatting with a user of another electronic device, wherein obtaining the name comprises: a name referring to a user of another electronic device is obtained in a chat input through the chat UI using the AI model.

Obtaining the name may include: while conducting a voice chat with a user of another electronic device, a name that refers to the user of the other electronic device is obtained in the voice chat using the AI model.

Storing the obtained names includes: based on obtaining a name referring to a user of another electronic device more than a predetermined number of times in a chat with the user of the other electronic device, the name is stored in association with contact information of the user of the other electronic device.

The control method may further include: storing a frequency of use of a name referring to a user of another electronic device in a chat with the user of the other electronic device; and in a case where a name identical to the name is stored in association with contact information of another user in addition to contact information of a user of another electronic device, making a call connection based on contact information of a user having a name with a higher frequency of use based on a user voice for making a call including the name being input.

The control method may further include: the message including the name at the beginning is transmitted based on the contact information of the user of the other electronic device based on the user voice including the name inputted for transmitting the message.

The control method may further include: obtaining schedule information associated with a user of another electronic device in a chat with the user of the other electronic device using the AI model; and storing the schedule information in association with contact information of a user of another electronic device.

The control method may further include: based on the user's voice input requesting information related to the chat counterpart in association with the schedule information, a reply message UI including a name referring to the user of the other electronic device is provided.

The control method may further include: adding a contact record with a user of another electronic device to the most recent contact record; and marking a name in a contact record with a user of another electronic device added to the most recent contact record.

According to another exemplary embodiment of the present disclosure, an electronic device includes a communicator, a memory, and a processor, wherein the communicator includes communication circuitry, the memory is configured to store computer-executable instructions, and the processor is configured to, by executing the computer-executable instructions: the control electronic device obtains a name referring to a user of another electronic device in a chat with the user of the other electronic device using an Artificial Intelligence (AI) model trained by an AI algorithm while chatting with the user of the other electronic device through the communicator, and stores the obtained name in a memory in association with contact information of the user of the other electronic device.

The electronic device may further comprise a microphone, wherein the processor may be further configured to: the control electronic device performs call connection based on contact information of a user of another electronic device based on the user's voice for making a call, which includes the obtained name, input through the microphone.

The processor may be further configured to: the control electronic device obtains a second name different from the first name in a chat with a user of another electronic device using the AI model based on a first name referring to the user of the another electronic device previously registered in contact information of the user of the another electronic device.

The electronic device may further comprise a display, wherein the processor may be further configured to: the control electronics provides a message User Interface (UI) inquiring whether to perform call connection to the counterpart of the first name through the display based on the user's voice for making a call including the second name input through the microphone.

The processor may be further configured to: the control electronic device provides a contact information UI including a phone number, a first name, and a second name of a user of another electronic device based on receiving a user input for viewing contact information of the user of the other electronic device.

The electronic device may further include a display, and the processor may be further configured to: the control electronic device provides a chat UI for chatting with a user of another electronic device through the display, and obtains a name referring to the user of the other electronic device in a chat input through the chat UI using the AI model.

The electronic device may further include a microphone, wherein the processor may be further configured to control the electronic device to obtain a name referring to a user of another electronic device in a voice chat using the AI model while the electronic device is performing the voice chat with the user of the another electronic device through the microphone.

Drawings

The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings in which:

fig. 1 is a diagram illustrating an electronic device for obtaining meaningful information in chatting with a counterpart, according to an embodiment of the present disclosure;

fig. 2 is a block diagram illustrating an exemplary configuration of an exemplary electronic device according to an embodiment of the present disclosure;

fig. 3 is a block diagram illustrating an exemplary configuration of an exemplary electronic device according to another embodiment of the present disclosure;

FIG. 4 is a flow chart illustrating an exemplary method of controlling an electronic device according to an embodiment of the present disclosure;

fig. 5 is a diagram illustrating an example of using a name of a counterpart obtained in chatting in a dialing function according to an embodiment of the present disclosure;

fig. 6 is a diagram illustrating an example of utilizing a name of a counterpart obtained in chatting in a dialing function according to another embodiment of the present disclosure;

fig. 7 is a diagram illustrating an example related to a messaging function according to an embodiment of the present disclosure;

fig. 8 is a diagram illustrating an example of making a call connection when a plurality of partners are referred to using the same name according to an embodiment of the present disclosure;

fig. 9 is a diagram illustrating an example of making a call connection when a plurality of partners are referred to using the same name according to another embodiment of the present disclosure;

fig. 10 is a diagram illustrating an example of obtaining schedule information in a chat according to an embodiment of the present disclosure;

FIG. 11A is a diagram illustrating an example of utilizing recent contact records, according to an embodiment of the present disclosure;

fig. 11B is a diagram illustrating an example of adding information obtained in a chat to a contact list, according to an embodiment of the present disclosure;

fig. 12 is a diagram illustrating an example of utilizing schedule information obtained in chatting, according to an embodiment of the present disclosure;

fig. 13 is a diagram illustrating an example of utilizing schedule information obtained in chatting, according to another embodiment of the present disclosure;

fig. 14 is a diagram illustrating an example of utilizing schedule information obtained in chatting, according to another embodiment of the present disclosure;

FIG. 15 is a diagram illustrating an example of registering contacts in association with a messaging application according to an embodiment of the present disclosure; and

fig. 16 is a flow diagram illustrating an exemplary network system using an AI model according to various embodiments of the present disclosure.

Detailed Description

The present disclosure will now be described in more detail with reference to the accompanying drawings, in which various exemplary embodiments of the disclosure are shown. It should be understood, however, that there is no intent to limit embodiments of the disclosure to the particular forms disclosed, but on the contrary, embodiments of the disclosure are to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure. Like reference symbols in the various drawings indicate like elements.

In the present disclosure, the expressions "have", "may have", "include", or "may include", "may include" used herein indicate the presence of the corresponding feature (e.g., an element such as a value, a function, an operation, or a component), but do not exclude the presence of additional features.

In the disclosure, the expression "a or B", "at least one of a or/and B" or "one or more of a or/and B", etc. may include all combinations of the listed items in relation. For example, the term "a or B", "at least one of a and B", or "at least one of a or B" may refer to all of the following: (1) a case including at least one A; (2) a case including at least one B; or (3) a case including both of at least one a and at least one B.

Terms such as "first," "second," and the like, as used herein may refer to various elements regardless of order and/or priority, and may be used to distinguish one element from another element without limitation. For example, "first user equipment" and "second user equipment" may represent different user equipment regardless of their order or priority. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure.

Terms such as "module", "unit", "component", and the like herein should be understood as a unit that handles at least one function or operation and may be implemented in hardware, software, or a combination of hardware and software. Also, a plurality of "modules," "units," "components," etc. may be integrated into at least one module or chip and implemented as at least one processor, unless each "module," "unit," "component," etc. needs to be implemented in separate specific hardware.

It will be understood that when an element (e.g., a first element) is referred to as being (operatively or communicatively) coupled/connected to another element (e.g., a second element) or connected to another element (e.g., a second element), it can be directly coupled/connected or connected to the other element or intervening elements (e.g., third elements) may be present. On the other hand, when an element (a first element) is referred to as being directly coupled/coupled to/directly connected to another element (e.g., a second element), it should be understood that no intermediate element (e.g., a third element) is present.

As used herein, "configured to" may be used interchangeably with, for example, the expressions "adapted to", "having … … capabilities to", "designed to", "adapted to", "made to", or "capable of", as the case may be. The term "configured to" does not necessarily mean "specially designed" in hardware. Rather, the expression "a device is configured to" may refer to a case where the device is "capable" of operating with another device or other component. For example, "the processor is configured (or set) to perform A, B and C" may refer to, for example but not limited to: a dedicated processor (e.g., an embedded processor) for performing the respective operations, a general-purpose processor (e.g., a Central Processing Unit (CPU) or an application processor) for performing the respective operations by executing one or more software programs stored in a storage device, and the like.

Terms used in the present disclosure may be used to describe particular embodiments and may not be intended to limit other embodiments. Unless otherwise specified, singular terms may include plural terms. Unless otherwise defined herein, all terms (including technical or scientific terms) used herein may have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in dictionaries, should also be interpreted as having a meaning that is commonly understood in the art and should not be interpreted in an idealized or overly formal sense unless expressly so defined herein. In some cases, even though the terms are the terms defined in the present disclosure, they may not be construed as being exclusive of the embodiments of the present specification.

Electronic apparatus (including control devices and controlled devices) according to various embodiments may include, for example and without limitation, at least one of a smart phone, a tablet Personal Computer (PC), a mobile phone, a video phone, an e-book reader, a desktop, a laptop, a notebook, a workstation, a server, a personal digital assistant (PAD), a Portable Multimedia Player (PMP), an MP3 player, a mobile medical device, a camera, a wearable device, and the like. According to various embodiments, the wearable device may include, for example, but not limited to, at least one of an accessory type (e.g., watch, ring, bracelet, necklace, glasses, contact lens or Head Mounted Device (HMD), a fabric or garment integrated type (e.g., electronic apparel), a body attachment type (e.g., a skin pad or tattoo), or an implantable type (e.g., implantable circuitry).

In some embodiments, the electronic device may be a household appliance. The home appliance may include, for example, but not limited to, at least one of a Television (TV), a Digital Video Disc (DVD) player, audio, a refrigerator, an air conditioner, a cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation panel, a security control panel, a TV box (e.g., Samsung HomeSyncTM, Apple TVTM, or Google TVTM), a game console (e.g., xbox and PlayStationTM), an electronic dictionary, an electronic key, a video camera, an electronic photo frame, and the like.

In another embodiment, the electronic device may include, for example, but is not limited to, a medical device (e.g., various portable medical measurement devices (e.g., a blood glucose monitoring device, a heart rate measurement device, a blood pressure measurement device, or a body temperature measurement device, etc.)), a Magnetic Resonance Angiography (MRA) device, a Magnetic Resonance Imaging (MRI) device, a computed tomography device (CT), a scanner, and an ultrasound device, etc.), a navigation device, a Global Navigation Satellite System (GNSS), an Event Data Recorder (EDR), a Flight Data Recorder (FDR), a vehicle infotainment device, a marine electronic equipment (e.g., a navigation system, a gyrocompass, etc.), an avionics device, a security device, a head unit, an industrial or home robot, an Automated Teller Machine (ATM) of a financial institution, a store point of sale (POS), or an internet of things (e.g., a light bulb, various sensors, An electric or gas meter, a sprinkler, a fire alarm, a thermostat, a street light, a toaster, fitness equipment, a hot water tank, a heater, a boiler, etc.), and the like.

According to an embodiment, the electronic device may include, for example, but not limited to, at least one of furniture or parts of a building/structure, an electronic board, an electronic signature receiving apparatus, a projector, various measuring instruments (e.g., a water meter, an electric meter, a gas meter, or a radio wave meter, etc.), and the like. In various embodiments, the electronic device may be one of the above-described apparatuses or a combination of one or more of the above-described apparatuses. The electronic device according to the embodiment may be a flexible electronic device. Further, the electronic device according to the embodiment may not be limited to the above-described apparatus, and may include an electronic device produced according to a technical development.

The present disclosure provides an electronic device capable of obtaining meaningful information in chatting with a counterpart and using the information in various functions, and a control method thereof. The present disclosure will be described in more detail below with reference to the accompanying drawings.

Fig. 1 is a diagram illustrating an electronic device 100 for obtaining meaningful information in chatting with a counterpart according to an embodiment of the present disclosure.

Referring to fig. 1, a user can chat with a user (counterpart) of another electronic device using an electronic device 100. For example, a user may use a chat application to chat. The electronic device 100 can obtain a name referring to the counterpart in a chat with the counterpart. In this example, a name referring to a counterpart in a chat may be identified using an Artificial Intelligence (AI) model trained by an AI algorithm.

Referring to fig. 1, the electronic device 100 may obtain "bulldog" indicating a name of the counterpart in a chat with the counterpart.

When obtaining a name referring to a chat counterpart, the electronic device 100 may store the obtained name in association with contact information of the counterpart. For example, as shown in fig. 1, the electronic apparatus 100 may add "bulldog" to a previously stored nickname item of a counterpart's contact. For example, in addition to a name "Hong Gil-Dong (huge girl)" previously registered in the contact information, another name that can refer to the other party may be added to the contact information.

In addition to a name referring to the counterpart, a keyword indicating a relationship with the counterpart, an address of the counterpart, and the like, which may be stored in contact information of the counterpart, may be obtained from the chat.

According to various embodiments of the present disclosure, meaningful information obtained in chatting as described above may be utilized. For example, the Hong Gil-Dong may be called by voice using the name "bulldog" obtained in the example depicted in fig. 1. When the electronic apparatus 100 receives the user voice "call bulldog", the electronic apparatus 100 may make a call connection based on the contact information of Hong Gil-Dong. Therefore, even if the user does not remember that the name of the other party is stored as "Hong Gil-Dong" in the contact information, the user can make a call to "bulldog" that the user often calls the other party.

Fig. 2 is a block diagram illustrating an exemplary configuration of the electronic apparatus 100 according to an embodiment of the present disclosure.

Referring to fig. 2, the electronic device 100 includes a communicator 110 (e.g., including communication circuitry), a memory 120, and a processor 130 (e.g., including processing circuitry). Some of the configurations may be omitted depending on the implementation, and although not shown, suitable hardware/software configurations that may be apparent to those skilled in the art may also be included in the electronic device 100.

The communicator 110 may include various communication circuits and may be connected to a network through, for example, wireless or wired communication to communicate with an external device. The wireless communication is, for example, a cellular communication protocol, and may use, for example, but not limited to, at least one of Long Term Evolution (LTE), LTE-advanced (LTE-a), Code Division Multiple Access (CDMA), wideband CDMA (wcdma), Universal Mobile Telecommunications System (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM), and the like. Further, wireless communication may include, for example, but is not limited to, short-range communication. Short-range communications may include, for example, but are not limited to, at least one of wireless direct (WiFi direct), bluetooth, Near Field Communication (NFC), Zigbee, and the like. The wired communication may include, for example, but not limited to, at least one of Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), recommended standard 232(RS-232), Plain Old Telephone Service (POTS), and the like. The network may include a telecommunications network such as, without limitation, at least one of a computer network (e.g., a LAN or WAN), the internet, a telephone network, and the like.

The communicator 110 may include various modules including, for example, various communication circuits (e.g., without limitation, a cellular module, a WiFi module, a bluetooth module, a GNSS module (e.g., a GPS module, a Glonass module, a beidou module, or a galileo module), an NFC module, a Radio Frequency (RF) module, etc.).

The cellular module may provide, for example, voice calls, video calls, text services, or internet services over a telecommunications network. According to an embodiment, the cellular module may use a subscriber identity module (e.g., a SIM card) for identification and authentication of the electronic device in the telecommunications network. According to an embodiment, the cellular module may perform at least some of the functions that the processor is capable of providing. According to an embodiment, the cellular module may include a Communication Processor (CP).

Each of the WiFi module, the bluetooth module, the GNSS module, and the NFC module may include, for example, a processor for processing data transmitted and received by the respective module. According to an embodiment, at least some (e.g., two or more) of the cellular module, the WiFi module, the bluetooth module, the GNSS module, or the NFC module may be included in one Integrated Chip (IC) or IC packet.

The RF module may transmit and receive, for example, communication signals (e.g., RF signals). The RF module may include, for example, a transceiver, a Power Amplification Module (PAM), a frequency filter, a Low Noise Amplifier (LNA), an antenna, and the like. According to another embodiment, at least one of the cellular module, the WiFi module, the bluetooth module, the GNSS module, or the NFC module may transmit and receive an RF signal through a separate RF module.

The memory 120 may include, for example, an internal memory and/or an external memory. The internal memory may include, for example, but is not limited to, at least one of volatile memory (e.g., dynamic ram (dram)), static ram (sram), synchronous dynamic ram (sdram), etc.), non-volatile memory (e.g., one-time programmable ROM (otprom), programmable ROM (prom), erasable programmable ROM (eprom), electrically erasable programmable ROM (eeprom), mask ROM, flash memory (e.g., NAND flash memory or NOR flash memory, etc.), a hard disk drive, a Solid State Drive (SSD), etc.

The external memory may include a flash drive such as, but not limited to, Compact Flash (CF), Secure Digital (SD), Micro secure digital (Micro SD), mini secure digital (Micro-SD), extreme digital (xD), multi-media card (MMC), memory stick, and the like.

The memory 120 is accessible by the processor 130 and can read/write/modify/delete/update data by the processor 130.

In the present disclosure, the term "memory" may include at least one of memory provided by the processor 130 alone, ROM (not shown) or RAM (not shown) in the processor 130.

Processor 130 may include various processing circuitry for controlling the overall operation of electronic device 100. For example, the processor 130 may drive an operating system and applications to control a plurality of hardware or software components connected to the processor 130, and may perform various data processing and operations. The processor 130 may include circuitry such as various processors, for example, but not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), or both. The processor 130 may be implemented, for example, as various processing circuitry such as, but not limited to, at least one general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a system on a chip (SoC), a microcomputer (MICOM), and so forth.

The processor 130 may perform various operations using the AI model trained by the AI algorithm. For example, the processor 130 may use the AI model trained by the AI algorithm to obtain meaningful information in chatting with a counterpart using the electronic device 100.

The AI module may be a decision model trained based on an AI algorithm and may be, for example, a neural network based model. The trained AI module may be designed to mimic human brain structures on a computer and may include a plurality of network nodes with weights that mimic neurons in a human neural network. A plurality of network nodes may form a connection relationship such that a neuron mimics synaptic activity of a neuron that sends and receives signals through synapses. Further, the trained AI model may include, for example, a neural network model or a deep learning model developed from a neural network model. In the deep learning model, multiple network nodes may be located at different depths (or levels) and may exchange data according to a convolutional connectivity relationship. Examples of the trained AI model may include, but are not limited to, a Deep Neural Network (DNN), a Recurrent Neural Network (RNN), a bi-directional recurrent deep neural network (BRDNN), and the like.

The electronic device 100 may use a personal assistant program (e.g., Bixby)^TM) I.e., an AI specific program (or AI agent). The personal assistant program may refer to, for example, a dedicated program to provide AI-based services. An existing general-purpose processor (e.g., sCPU) may be used for AI processing, or a single-purpose processor (e.g., GPU, FPGA, ASIC, etc.) may be used. The electronic device 100 may include a plurality of processors, such as an AI-specific processor and a processor responsible for other processing.

According to an embodiment of the present disclosure, the AI agent may operate (or may execute the AI agent) when a predetermined user input is input (e.g., an icon touch corresponding to the personal assistant chat robot, a user voice including a predetermined word, etc.) or a button provided on the electronic device 100 is pressed (a button for running the AI agent). The AI agent may be in a standby state before a predetermined user input is detected or before a button provided in the electronic device 100 is selected. The standby state may be, for example, a state in which reception of a predefined user input (e.g., when a user voice including a predetermined keyword (e.g., Bixby) is input) is detected to control the initiation of the operation of the AI agent. The electronic device 100 may operate the AI agent when a predetermined user input is detected or a button provided in the electronic device 100 is selected while the AI agent is in the standby state. The AI agent may perform a function of the electronic device 100 based on the voice when receiving the user voice, and may output a reply when the voice relates to the query.

The AI-based operation may be performed in the electronic device 100 or may be performed through an external server. In the former case, for example, the electronic device 100 may obtain meaningful information in chatting with the counterpart using the AI model. In the latter case, for example, the electronic device 100 may transmit a chat with the counterpart to the external server, and the external server may obtain meaningful information from the chat using the AI model and provide the information to the electronic device 100.

For example, the functions associated with designing an AI according to the present disclosure may be performed by a processor and a memory.

The processor may include one or more processors. The one or more processors may be general purpose processors (e.g., without limitation, CPUs, APs, etc.), special purpose processors such as graphics (e.g., without limitation, GPUs, VPUs, etc.), and/or special purpose processors such as AI (e.g., without limitation, NPUs).

The one or more processors may perform control to process the input data according to predefined operating rules stored in memory or in the AI model. Predefined operating rules or AI models can be created through learning.

In this example, creation by learning may refer to an AI model of a predefined operating rule or desired characteristic created, for example, by applying a learning algorithm to a plurality of learning data. In the AI performed according to the present disclosure, such learning may be performed in the device itself, or may be performed by a separate server/system.

The AI model may include a plurality of neural network layers. Each layer may have a plurality of weight values, and the operation of one layer may be performed by the operation result of the previous layer and the operation of the plurality of weights. Examples of neural networks include, for example, but are not limited to, Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), restricted boltzmann machines (RBNs), Deep Belief Networks (DBNs), Bidirectional Recursive Deep Neural Networks (BRDNNs), deep Q networks, and the like, and neural networks in the present disclosure are not limited to the above examples except as specified.

A learning algorithm may refer to, for example, a method of training a predetermined target device (e.g., a robot) using a plurality of learning data so that the predetermined target device alone may make a decision or make a prediction. Examples of learning algorithms may include, for example and without limitation, supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and the like, and learning algorithms in the present disclosure are not limited to the above examples except as specified.

Fig. 3 is a block diagram illustrating an exemplary configuration of the electronic apparatus 100 according to another embodiment of the present disclosure. As shown in fig. 3, electronic device 100 may include a communicator 110 (e.g., including communication circuitry), a memory 120, a processor 130 (e.g., including processing circuitry), a microphone 140, an input 150 (e.g., including input circuitry), a sound output 160 (e.g., including sound output circuitry), and a display 170. Some of the configurations may be omitted depending on the implementation, and although not shown, suitable hardware/software configurations that may be apparent to those of skill in the art may also be included in electronic device 100. The communicator 110, the memory 120, and the processor 130 are described with reference to fig. 2, and redundant description thereof may not be repeated here.

The microphone 140 may be a configuration that receives a user's voice or other sounds and converts them into digital signals. The processor 130 may obtain meaningful information, such as a name referring to the counterpart, a relationship with the counterpart, an address of the counterpart, etc., in the voice chat input through the microphone 140. The microphone 140 may be disposed inside the electronic device 100, but this is merely an example, and the microphone 140 may be disposed outside the electronic device 100 to be electrically connected to the electronic device 100.

The inputter 150 may include various input circuits and receive user input and transmit it to the processor 130. The inputter 150 may include, for example, but not limited to, a touch sensor, a (digital) pen sensor, a pressure sensor, a key, a microphone, and the like. The touch sensor may use at least one of a capacitive method, a resistive method, an infrared method, or an ultrasonic method, for example. The (digital) pen sensor may be part of a touch panel, for example, or may comprise a separate identification plate. The keys may include, for example, physical buttons, optical keys, or a keyboard.

The sound outputter 160 may include various sound output circuits and may output an audio signal. For example, the sound outputter 160 may output the voice of the counterpart received through the communicator 110. In addition, the sound outputter 160 may output audio data stored in the memory 120. For example, the sound outputter 160 may output various notification sounds and may output A I the voice of the assistant. The sound outputter 160 may include, for example, but not limited to, a receiver, a speaker, a buzzer, and the like.

The display 170 may be a configuration that outputs an image. The display 170 may be implemented as, for example, but not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, an Organic Light Emitting Diode (OLED) display (e.g., an Active Matrix Organic Light Emitting Diode (AMOLED), a passive matrix OLED (pmoled), or a micro-electro-mechanical system (MEMS) display), an electronic paper display, and the like. The touch sensor of the inputter 150 and the display 170 may be implemented as a touch screen by forming an inter-layer structure.

The memory 120 may store computer-executable instructions and, when the processor 130 executes the computer-executable instructions, may perform a control method of the electronic device 100 described in the present disclosure.

For example, the processor 130 may execute computer-executable instructions to control the electronic device, obtain a name referring to a user of another electronic device in a chat with the user of the other electronic device using an AI intelligence model trained by an AI algorithm while performing the chat with the user of the other electronic device through the communicator 110, and store the obtained name in the memory 120 in association with contact information of the user of the other electronic device.

Further, the processor 130 may execute the computer-executable instructions to control the electronic device to obtain a name referring to a user of another electronic device in the voice chat using the AI model while the voice chat is performed through the microphone 140.

Further, when a user's voice for making a call including the obtained name is input through the microphone 140, the processor 130 may control the electronic device to make a call connection based on contact information of a user of another electronic device.

In addition, the processor 140 may provide various UIs through the display 170. For example, the processor 140 may provide a UI for chatting, a UI for inquiring whether to make a call connection, a contact information UI, and the like through the display 170.

Fig. 4 is a flowchart illustrating an exemplary method of controlling the electronic device 100 according to an embodiment of the present disclosure.

Referring to fig. 4, in chatting with a user of another electronic device using the electronic device 100, a name referring to the user of the other electronic device is obtained in chatting with the user of the other electronic device using an AI model trained by an AI algorithm (S410).

In addition to the name referring to the counterpart, various types of meaningful information may be obtained in the chat, such as a keyword indicating a relationship with the counterpart, an address of the counterpart in the chat, schedule information related to the counterpart in the chat, and the like.

The electronic device 100 may support a text chatting function and a voice chatting function, and may obtain meaningful information using the AI model in the text chatting and the voice chatting.

The electronic device 100 may obtain and understand meaningful information in text using an AI model for Natural Language Processing (NLP). When inputting speech, the electronic device 100 may use a text-to-Speech (STT) technique that first converts speech to text. The AI model for analyzing the chatting with the counterpart may be provided in the electronic device 100 by itself, or the AI model may be provided in the external server so that the electronic device 100 transmits the chatting to the external server and the analysis result of the chatting is provided by the external server. Some processes of the chat analysis may be performed in the electronic device 100, and another processes may be performed in the external server. For example, the electronic device 100 may transmit a voice chat to an external server, and the external server may convert the voice into text and provide the text to the electronic device 100, and the electronic device 100 may perform NLP on the converted text.

Text chatting may be conducted through, for example, a messaging application. The messaging application may be installed in the electronic device 100, or may include a slave application store (such as Google Play)^TMOr Samsung Apps^TM) Downloaded messaging applications (e.g., KakaoTalk)^TM、Line^TM、WhatsApp^TMEtc.). Text chat may be, for example, in various forms such as, but not limited to, SMS, MMS, mail, and the like.

The electronic device 100 may provide a chat UI for chatting with a user of another electronic device. The chat UI may be provided by executing a messaging application, and may include an area to input chat text and an area to display a chat input by itself and a chat input by the other party. For example, the electronic device 100 may provide a chat UI 10 as shown in FIG. 1.

The electronic device 100 can obtain meaningful information (such as a name, a relationship, an address, etc. referring to a user of another electronic device) in a chat input through the chat UI using the AI model. For example, the electronic device 100 may obtain a name referring to the counterpart "Hong Gil-Dong", i.e., "bulldog", in the chat input to the chat UI 10 of FIG. 1.

May be provided by, for example, but not limited to, a general purpose phone, a voice over internet protocol (VoIP) based internet phone (e.g., Skype)^TM、FaceTime^TMEtc.) to conduct voice chatting.

The electronic device 100 can obtain meaningful information (such as a name, relationship, address, etc. referring to a user of another electronic device) in a voice chat using the AI model when the user of another electronic device is engaged in the voice chat. For example, the electronic device 100 may obtain a name referring to a user of another electronic device by converting a voice chat into text and inputting the converted text into the AI model using the AI model.

When a first name is previously registered in contact information of a user of another electronic device, the electronic device 100 may obtain a second name different from the first name in a chat with the user of the other electronic device using the AI model. That is, a name different from the previously stored name is obtained. When a name has not been previously registered, a new name can be obtained in the chat.

When obtaining the name, the electronic device 100 may store the obtained name in association with contact information of a user of another electronic device (420). For example, as described with reference to FIG. 1, a bulldog indicating Hong Gil-Dong in a chat with Hong Gil-Dong may be stored in association with contact information of the Hong Gil-Dong. When a variety of meaningful information (such as a keyword indicating a relationship with a counterpart, an address of the counterpart, etc.) is obtained in a chat in addition to the name of the counterpart, various meaningful information may be stored in association with contact information.

When a name referring to another electronic device is obtained more than a predetermined number of times in a chat with the other electronic device, the electronic device 100 may store the name in association with contact information of a user of the other electronic device. For example, it may be determined that the name refers to the other party only when the name is repeatedly used more than a predetermined number of times.

When receiving a user input for viewing a contact address of the counterpart, the electronic apparatus 100 may provide a contact information User Interface (UI) including a phone number of the counterpart and a name referring to the counterpart. For example, when receiving a user input for viewing a contact of a counterpart, as shown in fig. 1, the electronic device 100 may provide a contact information UI20, the contact information UI20 including the name of the counterpart "Hong Gil-Dong", the phone number "010-.

The function that can be performed using the name "Hong Gil-Dong" previously registered in the contact information can be performed in the same manner using another name "bulldog" obtained through chatting. According to an embodiment, the name obtained in the chat may be used for a dialing function.

Fig. 5 is a diagram illustrating an exemplary embodiment of the present disclosure in which names of partners obtained in chatting are utilized in a dialing function.

Referring to fig. 5, when the user inputs a voice of "call bulldog", the electronic apparatus 100 may search for bulldog among all contact names and nickname items and make a call connection based on HongGil-Dong having contact information nickname bulldog.

When the voice of "call bulldog" is input, the call connection fails because the AI assistant of the related art performs the call connection function only based on the stored name, and the call connection may succeed according to the embodiment of the present disclosure.

Instead of making the call immediately, the call may be made after the user confirms. For example, when a user's voice for making a call including a name obtained through chatting is input, the electronic apparatus 100 may provide a message UI inquiring whether to make a call connection to a counterpart previously registered with another name. An embodiment related to this example will be described in more detail below with reference to fig. 6.

Fig. 6 is a diagram illustrating another exemplary embodiment of the present disclosure relating to a dialing function.

Referring to fig. 6, when the user inputs a voice of "call bulldog", the AI assistant of the electronic device 100 may provide a message UI 610, and the message UI 610 inquires whether to make a call connection to another name (i.e., "Hong Gil-Dong") registered in contact information associated with the bulldog. When the voice of the user consent message UI 610 is input (e.g., "yes"), the electronic device 100 may make a call connection based on the contact information of Hong Gil-Dong corresponding to bulldog. When the voice of the message UI 610 is input that the user disagrees (e.g., "no"), the electronic apparatus 100 may not make a call connection.

In addition to the dial function, a name indicating a counterpart obtained through chatting may also be used in the message sending function. For example, when the user inputs the voice "speak a text message to the belldog telling him to see in the park today", the electronic device 100 may find the contact Hong Gil-Dong corresponding to the belldog and send a message "see in the park today" to the contact.

Fig. 7 is a diagram illustrating another exemplary embodiment of the present disclosure in relation to a messaging function.

The electronic device 100 may transmit a message using a name obtained in a chat with a user of another electronic device. For example, when a user voice including the obtained name for transmitting a message is input, the electronic apparatus 100 may transmit a message including the name at the beginning based on contact information of a user of another electronic apparatus.

For example, referring to FIG. 7, when the user inputs the voice "sending a text message to Hong Gil-Dong tells him to see in the park today", because electronic device 100 has obtained "belldog" in a normal chat with Hong Gil-Dong and stored it in contact information of Hong Gil-Dong, electronic device 100 may send a message including "belldog" at the beginning of the message, which is a nickname obtained in the contact details of Hong Gil-Dong. For example, as shown in fig. 7, the electronic device 100 may send a message "bulldog, see in park today". According to the embodiment, there is an advantage in that a message can be transmitted while calling a counterpart by a name commonly used in plain chatting.

The same name may be used to refer to multiple people. For example, the name stored in association with the contact information of the first user of the other electronic device and the name stored in association with the contact information of the second user of the other electronic device may be the same.

Fig. 8 is a block diagram illustrating an exemplary embodiment of the present disclosure for making a call connection when a plurality of partners are referred to using the same name.

Referring to fig. 8, in the case where the name "sweet heart" is stored in association with two pieces of contact information, when receiving a voice "call sweet heart" from a user, the electronic device 100 may provide a UI 810, which UI 810 indicates that there are a plurality of contacts having "sweet heart". When the user speaks a voice (e.g., "call Jane") that selects one of the contacts, the electronic device 100 may make a call connection based on Jane's contact address.

According to another embodiment of the present disclosure, when the same name is stored in a plurality of contact information, the plurality of contact information may be prioritized and used based on the frequency of use of the name.

For example, the electronic device 100 may store the frequency of use in a chat of a name referring to a user of another electronic device. For example, a frequency of use of a name referring to a first user and a frequency of use of a name referring to a second user may be stored. When the user's voice for making a call including the name is input, the electronic apparatus 100 may make a call connection based on the contact information of the user having the higher frequency of use of the name. An exemplary embodiment of this aspect will be described in more detail below with reference to fig. 9.

Referring to fig. 9, when receiving a voice of "call sweet heart" from a user, the electronic apparatus 100 searches for contact information of a person having "sweet heart", and when finding a plurality of contact information, may make a call connection based on the contact information of the person having the highest frequency of use of the name "sweet heart". In this example, a UI 910 may be provided to direct a call connection based on the contact information of the person with the highest frequency.

On the other hand, two or more nicknames may be stored in the contact information because one person may be called by a variety of nicknames.

Not only names referring to the opposite party but also other meaningful information can be obtained in the chat. For example, information related to an appointment or a schedule of the other party may be obtained.

According to an embodiment of the present disclosure, the electronic device 100 may obtain schedule information associated with a user of another electronic device in a chat with the user of the other electronic device by using an AI model, and store the obtained schedule information in association with contact information of the user of the other electronic device. The present embodiment will be described in more detail below with reference to fig. 10.

Fig. 10 is a diagram illustrating an exemplary embodiment of obtaining schedule information in a chat of the present disclosure.

Referring to fig. 10, a user of an electronic device 100 (e.g., user 1) performs a voice chat with a user of another electronic device (e.g., user 2) using the electronic device 100. The electronic apparatus 100 can obtain a name (i.e., "kill and chicken") referring to the user 2 in the chat using the AI model, and obtain schedule information (time information). The obtained information may be stored in association with the contact information of the user 2 and may then be utilized in various functions.

According to an embodiment of the present disclosure, information obtained in a chat may be stored in association with a time at which the chat occurs. For example, in an input such as "what time did i say with bulldog? "," who made the phone call at point 3? "etc., information about the time at which the chat occurred may be used when the AI assistant replies.

The message application or the phone application providing the chat service also records time information about when the chat occurs, and thus can use the message application or the phone application. For example, information about the last contact record provided by the phone application may be used.

According to an embodiment, when chatting (text chatting or voice chatting) with a user of another electronic device using the electronic device 100, a contact record with the user of another electronic device may be added to the recent contact record. Further, the contact record added to the latest contact record may be marked with information obtained from the chat (name indicating the counterpart, schedule information, etc.). The present embodiment will be described in more detail below with reference to fig. 11A.

FIG. 11A is a diagram illustrating an exemplary embodiment of the present disclosure utilizing a recent contact record. Fig. 11A will be described in conjunction with the chat of fig. 10.

Referring to fig. 11A, the electronic device 100 may add the time of chatting with the user 2 and the contact address of the user 2 described in fig. 10 to the recent contact record. When the contact address of user 2 is not a previously registered contact address, the contact record may be represented as a telephone number (02-1234-. Information obtained in the chat (for example, information about a name referring to the counterpart) and schedule information may be added to the added contact record in the form of a flag. For example, as shown in FIG. 11A, marker information 1110 may be displayed in the vicinity of the contact record.

According to another embodiment, information obtained in a chat may be provided to a schedule management application (e.g., a calendar application). For example, in a schedule management application, information such as "grill and chicken", "19: 00", and "appointment" may be included in a schedule of 4 months and 20 days in 2018.

According to an embodiment of the present disclosure, the electronic device 100 can distinguish whether a chat counterpart is a specific person, in which case information obtained in the chat is stored in the contact information, or a store name, in which case the store name is stored in the form of a tag in the latest contact record. For example, referring to fig. 1, when the chat correspondent is a person, the electronic device 100 may store the information obtained in the chat in the contact information of the contact application, and referring to fig. 11A, when the chat correspondent is a specific store name, the electronic device 100 may store the information obtained in the chat in the form of a tag in the recent contact record.

Schedule information obtained in chatting may be used in various situations. For example, when a user voice requesting information related to a chat counterpart associated with schedule information obtained in a chat is input, the electronic device 100 may provide a reply message UI including a name referring to a user of another electronic device. This will be described in more detail below with reference to fig. 12 to 14.

Fig. 12 is a diagram of an exemplary embodiment of the present disclosure utilizing schedule information obtained in chatting. Fig. 12 will be described in conjunction with the embodiment described with reference to fig. 11A.

Referring to fig. 12, what is the store name reserved when receiving a voice "Bixby, 4 months, 20 days, 19: 00? "the electronic device 100 recognizes the trigger keyword" Bixby "to activate the AI assistant, obtains time information from the voice, and searches for a store name corresponding to the obtained time information from the information marked in the contact record.

The electronic apparatus 100 may search for a contact record having tag information including time information "4 months, 20 days, 19: 00" obtained from the user's voice among the latest contact records. Referring to fig. 11A, the electronic device 100 may provide a response message UI 1210 using names "grill and chicken" referring to the counterpart based on information marked in the contact record, the response message UI 1210 including "the store names reserved at 19:00 on 4-month 20-day are 'grill and chicken'.

Fig. 13 is a diagram illustrating another exemplary embodiment of the present disclosure for utilizing schedule information obtained in chatting. Fig. 13 will be described with reference to the embodiment described in fig. 11A.

Referring to FIG. 13, when a voice "Bixby!is received from a user! When the grid and chicken "of the next friday reservation is called, the electronic apparatus 100 recognizes the trigger keyword" Bixby "to activate the AI assistant, obtains time information and a store name, and searches for a phone number corresponding to the obtained time information and the store name from the latest contact record.

The electronic apparatus 100 may search for a contact record having "20/4/2018" and "grill and chicken" as tag information corresponding to the time information "next friday" obtained from the user's voice from the latest contact record. Referring to fig. 11A, the electronic device 100 may find the contact record "02-1234-. In addition, the electronic device 100 may perform call connection to the contact record "02-1234-.

Fig. 14 is a diagram illustrating another exemplary embodiment of the present disclosure for utilizing schedule information obtained in chatting. Fig. 14 will be described in conjunction with the embodiment described in fig. 11A.

Referring to FIG. 14, when a voice "Bixby!is received from a user! When the time of the reservation is delayed by only 30 minutes "by messaging the grill and chicken reserved for the next friday, the electronic device 100 recognizes the trigger keyword" Bixby "to activate the AI assistant, obtains time information and a store name, and searches for a phone number corresponding to the obtained time information and store name from the latest contact record.

The electronic apparatus 100 may search for a contact record having "20/4/2018" and "grill and chicken" as tag information corresponding to the time information "next friday" obtained from the user's voice from the latest contact record. Referring to fig. 11A, the electronic device 100 may find the contact record "02-1234-. The electronic device 100 can confirm from the information marked in the contact record that the reserved time is 19:00, calculate the time that the user wants to change and send a text message requesting the reservation change to "02-1234-.

The information marked in the recent contact record may be deleted together when the user deletes the contact record, and may also be automatically deleted together after the expiration of the retention period of the contact record.

In addition to tagging information obtained in the chat to the most recent contact record, the electronic device 100 may provide information obtained in the chat to the schedule management application, and the personal assistant may use the information in the schedule management application to reply to the user according to the user's request.

According to another embodiment of the present disclosure, the electronic device 100 may add information obtained in the chat to the contact list. The present embodiment will be described with reference to fig. 11B.

Fig. 11B is a diagram illustrating an exemplary contact list UI 1100 provided by the electronic device 100, according to an embodiment of the present disclosure.

The electronic device 100 may provide a contact list UI 1100 of contact information stored in the electronic device 100. Contact list UI 1100 may include UI items that represent stored contacts. When a UI item is selected, the electronic device 100 may provide U I including detailed information (phone number, mail, etc.) of a contact corresponding to the selected UI item.

The electronic device 100 may add information (e.g., a name referring to the counterpart, a keyword indicating a relationship with the counterpart, an address of the counterpart, schedule information related to the counterpart, etc.) obtained from various chat types (e.g., a phone, a text message, a message application, a chat application, an SNS application, etc.) to the contact list. For example, the electronic device 100 may obtain the name "sweet heart" referring to short in a chat with Jane, obtain the name "bulldog" referring to Hong Gil-Dong in a chat with Hong Gil-Dong, and add the obtained information to the contact list. In this case, as shown in fig. 11B, the electronic apparatus 100 may provide a contact list UI 1100, the contact list UI 1100 including a "sweet heart" 1110 in the UI item "simple" and a "bulldog" 1120 in the UI item "Hong Gil-Dong".

According to another embodiment of the present disclosure, when searching for a contact in a contact list, even if a name obtained through chatting is searched, the contact can be searched in addition to an existing name. For example, referring to FIG. 11B, contacts may be searched by entering search terms into the contact list UI 1100. In this example, when searching for contacts using "bulldog" as the search term, the contact address of Hong Gil-Dong may be provided as the search result.

Fig. 15 is a diagram illustrating an exemplary embodiment of registering a contact in association with an SNS application of the present disclosure.

Referring to fig. 15, the electronic device 100 may be used in an SNS application (e.g., kakotalk)^TM、Facebook^TMEtc.) without searching for and registering a contact in a default contact application of the electronic device 100. For example, as shown in fig. 15, the contact addresses of the persons (i.e., Lee Gi-Baek) in the friend list of the SNS application, not the contact addresses of the persons in the default contact application of the electronic apparatus 100, may be newly registered in the default contact application of the electronic apparatus 100. In this example, the items of the contact may be populated with information provided by the SNS application. For example, the phone number item 1510, the mail address item 1520, the SNS ID item 1530, and the like may be populated based on information provided by the SNS application.

Meanwhile, the information provided based on the SNS application may not only newly register a contact but also fill in an empty item among items of existing contacts. For example, when the contact address item of Lee Gi-Baek has been registered in the default contact application of the electronic apparatus 100 and a mail address item among items constituting the contact address of Lee Gi-Baek is empty, the electronic apparatus 100 may receive the mail address of Lee Gi-Baek from the SNS application and fill it in the mail address item.

Further, the electronic device 100 may obtain information related to the counterpart (name referring to the counterpart, relationship with the counterpart, schedule with the counterpart, etc.) in the chat performed through the SNS application as described above, and the information includes information in the contact information. For example, the electronic device 100 may obtain a name "Husky (Husky)" referring to Lee Gi-Baek in a chat with Lee Gi-Baek through an SNS application, and fill the obtained name into the nickname item 1540 of the Lee Gi-Baek contact address of the default contact application.

In this manner, as described above, the information added to the contact information can be used for various functions such as a dialing function, a messaging function, answering a user voice query.

As described above, according to various embodiments of the present disclosure, contact information may be newly registered based on information obtained from various chat types, or information obtained from various chat types (e.g., a phone, a text message, a message application, a chat application, an SNS application, etc.) may be stored in association with existing contact information and may be used for various functions.

Fig. 16 is a flow diagram illustrating an example network system using an AI model according to various embodiments of the present disclosure.

In fig. 16, a network system using an AI model may include a first component 2010 and a second component 2020.

The first component 2010 may be an electronic device 100. The second component 2020 can be a server storing the AI model. The first component 2010 may be a general purpose processor and the second component 2020 may be an AI specific processor. The first component 2010 may be at least one application and the second component 2020 may be an Operating System (OS). For example, second component 2020 can be a more integrated, more dedicated, less delayed, higher performance, or more resource-intensive component than first component 2010, and can be a component that can process many operations needed in generating, updating, or applying a model faster, more efficiently than first component 2010.

An interface may be provided for transmitting/receiving data between the first and

second components

2010 and 2020.

For example, an Application Program Interface (API) may be provided having the learning data applied to the model as factor values (or parameter values or pass values). The API may include, for example and without limitation, a set of subroutines or functions that may be called for any process in any protocol (e.g., a protocol defined in an external server of the electronic device 100) another process (e.g., a protocol defined in the electronic device 100). For example, an API may provide an environment for operation of another protocol that may be executed in either protocol.

Referring to fig. 16, a user may communicate with a counterpart using a first component 2010 (S2001). For example, the first component 2010 can conduct a chat via a chat application or phone as described above.

The first component 2010 may transmit a chat between the user and the counterpart to the second component 2020 (S2003). In the case of text-based chatting, the chatting text may be transmitted to the second component 2020, and in the case of voice-based chatting, audio data including voice may be transmitted to the second component 2020, or the first component 2010 may convert voice into text and transmit the converted text to the second component 2020.

The second component 2020 can obtain information related to the other party in a chat, e.g., using a trained AI model (S2005). The information related to the counterpart may include information such as, but not limited to, a name referring to the counterpart, a relationship with the counterpart, an address of the counterpart, a schedule with the counterpart, and the like. In this regard, the AI model may be a model trained to identify information related to a party in a chat by using the chat as input data.

The second component 2020 can transmit information related to the counterpart obtained in the chat to the first component 2010 (S2007).

The first component 2010 may store the information related to the counterpart obtained in the chat in association with the contact information of the counterpart (S2009).

Further, the first component 2010 may utilize the information related to the counterpart stored in association with the contact information in various cases. For example, as in the above-described example, when the user inputs a voice for requesting a call, the first component 2010 may search for contact information corresponding to a name referring to a counterpart included in the voice and make a call connection based on the contact information.

According to the above-described embodiments, meaningful information can be obtained from a personal private chat and can be utilized in various functions, and thus various user experiences are possible and not limited to existing predetermined names or the like and the personal private chat has more information related to a counterpart, and thus can utilize this information.

The various embodiments described herein may be implemented in software, hardware, or any combination thereof. The embodiments described herein may be implemented in hardware using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, or an electronic unit for instructing another function. In particular, various embodiments described herein may be implemented by the processor 130 of the electronic device 100. Embodiments relating to the programs or functions may be implemented in software with separate software modules. Each of the software modules is capable of performing at least one function or operation described herein.

Various embodiments of the disclosure are implemented on software comprising instructions that may be stored in a machine-readable storage medium. The machine is an apparatus capable of calling stored instructions from a storage medium and operating according to the called instructions, and may include the control device 200 of the embodiment.

When the processor executes the instructions, the processor may use other elements to perform the functions corresponding to the instructions, directly or under the control of the processor. The instructions may include code made by a compiler or code executable by an interpreter. The control method of the electronic apparatus 100 described above may be performed, for example, by executing instructions stored in a storage medium by a processor. For example, by executing instructions stored in a storage medium by a processor of an apparatus (or an electronic device), a control method may be performed that includes, while chatting with a user of another electronic device using the electronic device, obtaining a name referring to the user of the other electronic device in a chat with the user of the other electronic device using an AI model trained by an AI algorithm, and storing the obtained name in association with contact information of the user of the other electronic device.

The machine-readable storage medium may be provided in the form of a non-transitory storage medium. A "non-transitory" storage medium is tangible, but does not distinguish whether data is semi-permanently stored in the storage medium or temporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments herein may be provided in a computer program product. The computer program product may conduct transactions between sellers and buyers as goods. The computer program product may include a product in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)) or may pass through an application Store (e.g., Google Play Store)^TMOr AppStore^TM) And (4) online distribution. In the case of electronic distribution, at least part of the computer program product may be temporarily stored on or created in a storage medium such as a memory of a server of the manufacturer, a memory of a server of an application store or a memory of a relay server.

In various embodiments, each component (e.g., module or program) according to various embodiments may be composed of a single entity or multiple entities, some of the above-described sub-components may be omitted, or other sub-components may also be included. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity to perform the functions performed by each corresponding component prior to integration in the same or similar manner. Operations performed by a module, program, or other component according to various embodiments may be performed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be performed in a different order, omitted, or another operation may be added.

Although various exemplary embodiments have been shown and described in the present disclosure, the present disclosure is not limited to the above exemplary embodiments, and various modifications may be made by those skilled in the art without departing from the spirit and scope of the present disclosure, such as defined by the claims.

Claims

1. A method of controlling an electronic device, the method comprising:

while using the electronic device to chat with a user of another electronic device, obtaining a name referring to the user of the other electronic device in a chat with the user of the other electronic device using an AI model trained by an AI algorithm; and

storing the obtained name in association with contact information of a user of the other electronic device.

2. The method of claim 1, further comprising: performing a call connection based on contact information of the user of the other electronic device based on the user's voice for making a call including the obtained name being input.

3. The method of claim 1, wherein obtaining the name comprises:

obtaining a second name different from the first name in a chat with the user of the other electronic device using the AI model based on a first name previously registered in contact information of the user of the other electronic device referring to the user of the other electronic device.

4. The method of claim 3, further comprising: providing a message UI inquiring whether to perform call connection to a counterpart of the first name based on the input of the user voice for making a call including the second name.

5. The method of claim 3, further comprising: providing a contact information UI including a phone number, the first name, and the second name of a user of the other electronic device based on receiving a user input for viewing contact information of the user of the other electronic device.

6. The method of claim 1, further comprising:

providing a chat UI for the chat with the user of the other electronic device,

wherein obtaining the name comprises: obtaining a name referring to a user of the other electronic device in the chat input through the chat UI using the AI model.

7. The method of claim 1, wherein obtaining the name comprises: while conducting a voice chat with a user of the other electronic device, obtaining the name referring to the user of the other electronic device in the voice chat using the AI model.

8. The method of claim 1, wherein storing the obtained name comprises: based on obtaining a name referring to a user of the other electronic device more than a predetermined number of times in a chat with the user of the other electronic device, the name is stored in association with contact information of the user of the other electronic device.

9. The method of claim 1, further comprising:

storing a frequency of use of a name referring to a user of the other electronic device in a chat with the user of the other electronic device; and

in a case where a name identical to the name is stored in association with contact information of another user in addition to the contact information of the user of the other electronic device, based on the user's voice for making a call including the name being input, a call connection is performed based on the contact information of the user having a higher frequency of use of the name.

10. The method of claim 1, further comprising: transmitting the message including the name at the beginning of the message based on contact information of a user of the other electronic device based on the user voice including the name inputted for transmitting the message.

11. The method of claim 1, further comprising:

obtaining schedule information associated with a user of the other electronic device in a chat with the user of the other electronic device using the AI model; and

storing the schedule information in association with contact information of a user of the other electronic device.

12. The method of claim 11, further comprising: providing a reply message UI including a name referring to a user of the other electronic device based on a user voice input requesting information related to a chat counterpart associated with the schedule information.

13. The method of claim 1, further comprising:

adding a contact record with a user of the other electronic device to a most recent contact record; and

marking the name in a contact record with a user of the other electronic device added to the most recent contact record.

14. An electronic device, comprising:

a communicator including a communication circuit;

a memory configured to store computer-executable instructions; and

a processor configured to, by executing the computer-executable instructions: control the electronic device to obtain, while chatting with a user of another electronic device through the communicator, a name referring to the user of the another electronic device in a chat with the user of the another electronic device using an AI model trained by an AI algorithm, and store the obtained name in the memory in association with contact information of the user of the another electronic device.

15. The electronic device of claim 14, further comprising: a microphone (C) is (are) provided,

wherein the processor is further configured to control the electronic device to: performing call connection based on contact information of the user of the other electronic device based on the user's voice for making a call including the obtained name input through the microphone.