KR20210065308A - Electronic apparatus and the method thereof - Google Patents

Abstract

According to one embodiment of the present invention, provided is an electronic device, which may identify the state of the electronic device according to a state value indicated by a plurality of state items of the electronic device, generate a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device, and provide a search result obtained based on the generated search phrase.

Description

Electronic device and its control method

The present invention relates to an electronic device that provides a solution according to the device state of the electronic device, and a control method therefor.

With the recent development of technology, functions provided by electronic devices have increased, and usage environments have been diversified. Accordingly, when an error occurs in the electronic device or when the user wants to change the use environment, it may be difficult to find a solution suitable for the situation.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an electronic device capable of providing a user with a solution suitable for various situations and a method for controlling the same.

In the electronic device according to an embodiment of the present invention, the state of the electronic device is identified according to state values indicated by a plurality of state items of the electronic device, and a plurality of states obtained based on the identified states of the electronic device are identified. A search phrase may be generated using a search keyword, and a search result obtained based on the generated search phrase may be provided.

The processor may generate the search phrase based on a model trained to align the arrangement order of the plurality of search keywords.

The model may be trained to identify the state of the electronic device according to state values indicated by the plurality of state items.

The model may be trained to obtain the plurality of search keywords based on the identified state of the electronic device.

The model may be trained such that the search keyword includes similar keywords.

The processor may classify the plurality of state items by category, and identify the states of the electronic device based on information indicating states of the plurality of electronic devices for each state value indicated by the classified plurality of state items.

The processor may identify the state of the electronic device based on information corresponding to a current state value among information prepared for each of a plurality of state values of the electronic device.

The processor may generate the search phrase by additionally using the user's usage history.

The use history may include at least one of a connection history of an external device, an application use history, and a search history.

The processor adjusts a weight of a state of a corresponding electronic device among states of a plurality of electronic devices based on the user's usage history, and identifies a state of the electronic device corresponding to the state value based on the adjusted weight. can do.

The processor may generate the search phrase by additionally using a setting history of the electronic device.

The processor may provide a search result selected based on a predefined priority among the plurality of obtained search results.

The priority may include the number of times another user searches for the search result.

The processor may obtain the search result based on a search phrase selected by a user input among a plurality of the search phrases.

The processor may perform a subsequent operation based on a search result selected by a user input among a plurality of search results.

In a control method of an electronic device according to an embodiment of the present invention, the method comprising: identifying a state of the electronic device according to state values indicated by a plurality of state items of the electronic device; generating a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device; and providing a search result obtained based on the generated search phrase.

The generating of the search phrase may include generating the search phrase based on a model trained to align an arrangement order of the plurality of search keywords.

The identifying of the state of the electronic device may include: classifying the plurality of state items into categories; The method may include identifying states of the electronic devices based on information indicating states of a plurality of electronic devices for each state value indicated by the plurality of classified state items.

The generating of the search phrase may include generating the search phrase by additionally using a user's usage history.

In the recording medium storing a computer program including a computer-readable code for performing a control method of an electronic device, the control method of the electronic device is based on a state value indicated by a plurality of status items of the electronic device. identifying the state of the electronic device according to the method; generating a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device; and providing a search result obtained based on the generated search phrase.

The present invention can efficiently solve a user's requirements that occur while the user uses the electronic device, thereby increasing the user's convenience in using the electronic device.

1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present invention.
2 is a diagram illustrating an operation flowchart of an electronic device according to an embodiment of the present invention.
3 is a diagram illustrating a status item of an electronic device according to an embodiment of the present invention.
4 is a diagram illustrating a status item of an electronic device according to an embodiment of the present invention.
5 is a diagram illustrating a user's electronic device usage history according to an embodiment of the present invention.
6 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention.
7 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention.
8 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention.
9 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numbers or symbols refer to components that perform substantially the same function, and the size of each component in the drawings may be exaggerated for clarity and convenience of description. However, the technical spirit of the present invention and its core configuration and operation are not limited to the configuration or operation described in the following embodiments. In describing the present invention, if it is determined that a detailed description of a known technology or configuration related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

In an embodiment of the present invention, terms including an ordinal number such as first, second, etc. are used only for the purpose of distinguishing one element from another element, and the expression of the singular is plural unless the context clearly indicates otherwise. includes the expression of In addition, in an embodiment of the present invention, terms such as 'consisting', 'comprising', 'having' and the like are one or more other features or the presence of numbers, steps, operations, components, parts, or combinations thereof. Or it should be understood that the possibility of addition is not excluded in advance. In addition, in an embodiment of the present invention, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software or a combination of hardware and software, and is integrated into at least one module. and can be implemented. Further, in an embodiment of the present invention, at least one of the plurality of elements refers to all of the plurality of elements as well as each one or a combination thereof excluding the rest of the plurality of elements.

1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present invention.

Hereinafter, the configuration of the electronic device 100 will be described. The electronic device 100 may be implemented as a display device capable of displaying an image. For example, the electronic device 100 may include a TV, a computer, a smart phone, a tablet, a portable media player, a wearable device, a video wall, an electronic picture frame, and the like. In addition, the electronic device 100 may be implemented as various types of devices, such as an image processing device such as a set-top box without a display, household appliances such as a Bluetooth speaker, a refrigerator, a washing machine, and an information processing device such as a computer body.

When the electronic device 100 does not include a display, components for displaying an image such as the display unit 240 may not be included. For example, when the electronic device 100 is implemented as a set-top box, the electronic device 100 may output an image signal or the like to an external display device such as a TV through the interface unit 110 .

1 , the electronic device 100 may include an interface unit 110 . The interface unit 110 may include a wired interface unit 111 . The wired interface unit 111 includes a connector or port to which an antenna capable of receiving a broadcast signal according to a broadcasting standard such as terrestrial/satellite broadcasting can be connected, or a cable capable of receiving a broadcast signal according to the cable broadcasting standard can be connected. do. As another example, the electronic device 100 may have a built-in antenna capable of receiving a broadcast signal. The wired interface unit 111 is configured according to video and/or audio transmission standards, such as HDMI port, DisplayPort, DVI port, Thunderbolt, composite video, component video, super video, SCART, etc. It may include a connector or port, and the like. The wired interface unit 111 may include a connector or port according to a universal data transmission standard such as a USB port. The wired interface unit 111 may include a connector or a port to which an optical cable can be connected according to an optical transmission standard. The wired interface unit 111 is connected to an external microphone or an external audio device having a microphone, and may include a connector or a port capable of receiving or inputting an audio signal from the audio device. The wired interface unit 111 is connected to an audio device such as a headset, earphone, or external speaker, and may include a connector or port capable of transmitting or outputting an audio signal to the audio device. The wired interface unit 111 may include a connector or port according to a network transmission standard such as Ethernet. For example, the wired interface unit 111 may be implemented as a LAN card connected to a router or a gateway by wire.

The wired interface unit 111 is wired through the connector or port in a 1:1 or 1:N (N is a natural number) method such as an external device such as a set-top box, an optical media playback device, or an external display device, speaker, server, etc. By being connected, a video/audio signal is received from the corresponding external device or a video/audio signal is transmitted to the corresponding external device. The wired interface unit 111 may include a connector or port for separately transmitting video/audio signals.

Also, according to the present embodiment, the wired interface unit 111 is embedded in the electronic device 100 , but may be implemented in the form of a dongle or a module to be detachably attached to the connector of the electronic device 100 . The interface unit 110 may include a wireless interface unit 112 . The wireless interface unit 112 may be implemented in various ways corresponding to the implementation form of the electronic device 100 . For example, the wireless interface unit 112 is a communication method RF (radio frequency), Zigbee (Zigbee), Bluetooth (bluetooth), Wi-Fi (Wi-Fi), UWB (Ultra WideBand) and NFC (Near Field Communication), etc. Wireless communication can be used. The wireless interface unit 112 may be implemented as a wireless communication module that performs wireless communication with an AP according to a Wi-Fi method, or a wireless communication module that performs one-to-one direct wireless communication such as Bluetooth. The wireless interface unit 112 may transmit and receive data packets to and from the server by wirelessly communicating with the server on the network. The wireless interface unit 112 may include an IR transmitter and/or an IR receiver capable of transmitting and/or receiving an IR (Infrared) signal according to an infrared communication standard. The wireless interface unit 112 may receive or input a remote control signal from a remote control or other external device through an IR transmitter and/or an IR receiver, or transmit or output a remote control signal to another external device. As another example, the electronic device 100 may transmit/receive a remote control signal to and from the remote control or other external device through the wireless interface unit 112 of another method such as Wi-Fi or Bluetooth.

When the video/audio signal received through the interface unit 110 is a broadcast signal, the electronic device 100 may further include a tuner for tuning the received broadcast signal for each channel.

The electronic device 100 may include a display unit 120 . The display unit 120 includes a display panel capable of displaying an image on the screen. The display panel is provided with a light-receiving structure such as a liquid crystal type or a self-luminous structure such as an OLED type. The display unit 120 may further include additional components according to the structure of the display panel. For example, if the display panel is a liquid crystal type, the display unit 120 includes a liquid crystal display panel and a backlight unit for supplying light. and a panel driving substrate for driving the liquid crystal of the liquid crystal display panel.

The electronic device 100 may include a user input unit 130 . The user input unit 130 includes various types of input interface related circuits provided to perform user input. The user input unit 130 may be configured in various forms depending on the type of the electronic device 100 , for example, a mechanical or electronic button unit of the electronic device 100 , a remote controller separated from the electronic device 100 , and a touch screen. There is a pad, a touch screen installed on the display unit 120, and the like.

The electronic device 100 may include a storage unit 140 . The storage unit 140 stores digitized data. The storage unit 140 has a non-volatile property that can preserve data regardless of whether or not power is provided, and data to be processed by the processor 170 is loaded, and data is stored when power is not provided. It includes memory of volatile properties that cannot. Storage includes flash-memory, hard-disc drive (HDD), solid-state drive (SSD), read-only memory (ROM), etc., and memory includes buffers and random access memory (RAM). etc.

The electronic device 100 may include a microphone 150 . The microphone 150 collects sounds of the external environment including the user's voice. The microphone 150 transmits the collected sound signal to the processor 170 . The electronic device 100 may include a microphone 150 for collecting user voices or may receive a voice signal from an external device such as a remote controller having a microphone or a smart phone through the interface unit 110 . A remote controller application may be installed in an external device to control the electronic device 100 or perform functions such as voice recognition. In the case of an external device installed with such an application, a user voice may be received, and the external device may transmit/receive and control data using the electronic device 100 and Wi-Fi/BT or infrared rays, etc. A plurality of interface units 110 that can be implemented may exist in the electronic device 100 .

The electronic device 100 may include a speaker 160 . The speaker 160 outputs audio data processed by the processor 170 as sound. The speaker 160 may include a unit speaker provided to correspond to audio data of one audio channel, and may include a plurality of unit speakers to respectively correspond to audio data of a plurality of audio channels. In the present invention, the speaker 160 may output the search result when the search result is composed of audio data because the electronic device 100 does not have a display or does not have a display, but the search result is not limited to video data. As another embodiment, the speaker 160 may be provided separately from the electronic device 100 . In this case, the electronic device 100 may transmit audio data to the speaker 160 through the interface unit 110 .

The electronic device 100 may include a processor 170 . The processor 170 includes one or more hardware processors implemented with a CPU, a chipset, a buffer, a circuit, etc. mounted on a printed circuit board, and may be implemented as a system on chip (SOC) depending on a design method. When the electronic device 100 is implemented as a display device, the processor 170 includes modules corresponding to various processes such as a demultiplexer, a decoder, a scaler, an audio digital signal processor (DSP), and an amplifier. Here, some or all of these modules may be implemented as SOC. For example, a module related to image processing such as a demultiplexer, decoder, and scaler may be implemented as an image processing SOC, and an audio DSP may be implemented as a chipset separate from the SOC.

When the processor 170 obtains a voice signal for the user's voice by the microphone 150 or the like, the processor 170 may convert the voice signal into voice data. In this case, the voice data may be text data obtained through a speech-to-text (STT) process for converting a voice signal into text data. The processor 170 identifies a command indicated by the voice data, and performs an operation according to the identified command. The voice data processing process and the command identification and execution process may all be executed in the electronic device 100 . However, in this case, since the system load and required storage capacity required for the electronic device 100 are relatively increased, at least a part of the process is performed by at least one server communicatively connected to the electronic device 100 through a network. can be performed.

The processor 170 according to the present invention may call at least one command among commands of software stored in a storage medium readable by a machine such as the electronic device 100 and execute it. This enables a device such as the electronic device 100 to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term refers to cases in which data is semi-permanently stored in a storage medium and temporarily stored. It does not distinguish between cases where

Meanwhile, the processor 170 identifies the state of the electronic device according to the state value indicated by the plurality of state items, and during data analysis, processing, and result information generation for generating a search phrase based on the identified state of the electronic device. At least a portion may be performed using at least one of machine learning, a neural network, or a deep learning algorithm as a rule-based or artificial intelligence algorithm.

For example, the processor 170 may perform the functions of the learning unit and the recognition unit together. The learner may perform a function of generating a learned neural network, and the recognizer may perform a function of recognizing (or inferring, predicting, estimating, or judging) data using the learned neural network. The learning unit may generate or update the neural network. The learning unit may acquire learning data to generate a neural network. For example, the learning unit may acquire the learning data from the storage unit 140 or the outside. The learning data may be data used for learning of the neural network, and the neural network may be trained by using the data obtained by performing the above-described operation as learning data.

The learning unit may perform a preprocessing operation on the acquired training data before training the neural network using the training data, or may select data to be used for learning from among a plurality of training data. For example, the learning unit may process the learning data into a preset format, filter it, or add/remove noise to process the learning data into a form suitable for learning. The learner may generate a neural network set to perform the above-described operation by using the preprocessed learning data.

The learned neural network network may be composed of a plurality of neural network networks (or layers). Nodes of the plurality of neural networks have weights, and the plurality of neural networks may be connected to each other so that an output value of one neural network is used as an input value of another neural network. Examples of neural networks include Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN) and It can include models such as Deep Q-Networks.

Meanwhile, the recognizer may acquire target data to perform the above-described operation. The target data may be obtained from the storage 140 or from the outside. The target data may be data to be recognized by the neural network. The recognizer may perform preprocessing on the acquired target data before applying the target data to the learned neural network, or select data to be used for recognition from among a plurality of target data. For example, the recognition unit may process the target data into a preset format, filter, or add/remove noise to process the target data into a form suitable for recognition. The recognizer may obtain an output value output from the neural network by applying the preprocessed target data to the neural network. The recognition unit may obtain a probability value or a reliability value together with the output value.

For example, the control method of the electronic device 100 according to the present invention may be provided by being included in a computer program product. The computer program product may include instructions for software executed by the processor 170 , as described above. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg, CD-ROM), or via an application store (eg, Play Store™) or between two user devices (eg, smartphones). It can be distributed directly, online (eg, downloaded or uploaded). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

2 is a diagram illustrating an operation flowchart of an electronic device according to an embodiment of the present invention. According to an embodiment of the present invention, the electronic device 100 has a plurality of functions, and a plurality of status items exist according to each function. The processor 170 identifies the state of the electronic device according to the state values indicated by the plurality of state items of the electronic device 100 ( S210 ). State items (Context) include network connection status, communication bandwidth, and computing context items such as printer, display, and workstation, user context including user information, location, and people around; It includes physical status items such as screen brightness and sound volume, and temporal status items related to time (Time context). The state item may be identified and collected by the processor 170 through various sensing devices and applications and used to provide various application services, or may be used to define the state of the electronic device in combination with other state information. In this case, the state value is a value that continuously changes according to the state of the electronic device 100 and means an actual value of the electronic device 100 for each state item. That is, the processor 170 identifies the state of the electronic device corresponding to the current state value of the electronic device 100 among the plurality of states of the electronic device through each state value of the plurality of state items identified by the electronic device 100 . can do. In this case, the processor 170 may store information on the state of the electronic device 100 in the storage unit 140 or receive information about the state of the electronic device from the server, but is not limited thereto. . Then, the processor 170 generates a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device (S220). Since the data based on the identified state of the electronic device includes keywords, the processor 170 may generate a search phrase by using them according to a predefined criterion. The processor 170 provides a result obtained based on the generated search phrase (S230). The processor 170 searches through the device guide stored in the server or the storage unit 140 using the generated search phrase, and provides the obtained result.

When an error occurs in the electronic device while using the electronic device, the user may want to solve the problem or change the use environment. However, as technology develops, functions and usage environments of electronic devices are diversified, and it may be difficult for a user to find a solution suitable for a situation. Accordingly, it is difficult for the user to know exactly where to find the necessary information, how to find the information, or what kind of information the user needs from the vast amount of information due to the development of the Internet when the user is having difficulties with an operation or environment that is different from the user's intention.

According to an embodiment of the present invention, the electronic device 100 generates a search phrase according to the state of the electronic device based on the state value of the device and provides a search result. It is possible to efficiently solve the requirements, thereby increasing the convenience of using the electronic device.

3 is a diagram illustrating a hierarchical structure in which state items of an electronic device are classified according to an embodiment of the present invention. The status item of the electronic device according to an embodiment of the present invention may be determined based on data such as a user manual of the electronic device, but is not limited thereto. In addition, the processor 170 may generate different hierarchical structures as data such as user manuals are set by various languages, and may update the corresponding hierarchical structure when the language setting in the electronic device 100 is changed.

As shown in FIG. 3 , status items of the electronic device are classified hierarchically based on information including a user manual. For example, assuming that the electronic device 100 is a TV, the problem category may be broadly classified into a screen, a sound, a network, and the like. In this case, the contents within the square brackets (<, >) correspond to the type that classifies the status items, such as problem category, and 'screen', 'sound', and 'network' correspond to keywords for generating search phrases. More details will be described later with reference to FIG. 4 .

Among them, if you look closely at the sound category (problem category, 311), it can be divided into sound-related symptoms (symptom, 321, 322) that may occur in electronic devices, such as no sound or strange sound although sound is produced. The item 321 in which no sound is produced may be classified as a device in which no sound is produced, that is, a device connected to a TV (connection devices 331 and 332 ). According to an embodiment of the present invention, in the case of a TV, sound may not be output from the TV itself or from a device connected to the TV, for example, a sound bar. Among them, in the case of being connected to the TV itself, the TV setting exists as a solution (solution category, 341), and furthermore, the TV volume and TV sound mode are the reasons for such a state (solution reason, 351, 352). . The items 361 and 362 classified thereafter are end items of the state item having a hierarchical structure, and it is possible to compare whether the end item matches the current state of the electronic device based on the current state value of the TV.

When the connected device 332 returns to the sound bar item, the sound bar may be classified into a connection type connected to the TV (connection type 371 , 372 , 373 ). The sound bar can be connected to the TV through optical, HDMI, or Bluetooth formats. Among them, if the optical type is reclassified, TV setting, sound bar setting, cable and HW exist as a solution category (342, 343, 344), and furthermore, the reason for such a state (solution reason, 351, 352) have TV volume and TV sound modes. Similarly in this case, the item 363 classified thereafter is a terminal item, and it is possible to compare whether the terminal item matches the current state of the electronic device based on the current state value of the TV.

The status items shown in FIG. 3 are not limited thereto, and status items may be added or deleted in some cases. This is also true of the contents disclosed in each state item.

According to an embodiment of the present invention, the hierarchical structure of the illustrated state items is classified into functions and usage environments of one device, and the processor 170 refers to the hierarchical structure of the states of a plurality of electronic devices. can be defined. Accordingly, when generating a search phrase based on the state of the electronic device, the processor 170 may obtain a keyword for logically and efficiently generating a search phrase by utilizing this structure.

4 is a diagram illustrating a status item of an electronic device according to an embodiment of the present invention, and FIG. 5 is a diagram illustrating a user's history of using an electronic device according to an embodiment of the present invention.

According to FIG. 4 , it is possible to extract a usable state item according to a situation by using the states of the plurality of electronic devices defined as described above in FIG. 3 .

For example, when the electronic device 100 is a TV, if a situation in which no sound is output from the sound bar connected to the TV is a defined device state, the processor 170 may extract a state item related thereto. Therefore, based on the TV volume, TV sound mode, and sound bar settings, it is possible to extract up to the highest state item as related state items along the hierarchical structure of FIG. 4 . That is, in the case of TV volume and TV sound mode, TV setting, sound, no sound, and sound can be extracted, and in case of sound bar setting, sound bar setting, optical, sound bar, no sound, and sound can be extracted.

When the state item is extracted, the processor 170 may create a dictionary in which state items composed of types and keywords are combined as described above with reference to FIG. 3 . This is to use the type and keyword when the processor 170 later generates a search phrase based on the identified state of the electronic device. In this case, the processor 170 may also add a keyword similar to the keyword extracted from the state item in advance in order to efficiently generate a search phrase. For example, in the case of TV setting, there are a TV connection, a TV setting method, a connection method, and the like.

In the case of FIG. 5 , the generation of a search phrase using the generated dictionary is illustrated. According to an embodiment of the present invention, generating the search phrase may be performed by the processor 170 using a predefined algorithm or by using a machine-based learned model. The processor 170 may generate a search phrase based on a keyword and a type extracted according to a situation in which no sound is produced from the sound bar in FIG. 4 and a dictionary generated based thereon. For example, the processor 170 uses "<device> <connection type> <symptom>" among the types extracted in FIG. 4 to search for related keywords and similar keywords from the generated dictionary, "Sound bar optical setting method", You can create sentences such as "How to connect the sound bar with optical", "No sound from the optical sound bar", and "No optical sound bar connected". When using the plurality of keywords, the processor 170 may arrange the arrangement order of the plurality of keywords. The processor 170 may use a model in which a general or specific user's utterance tendency has been learned in order to arrange the arrangement order of the plurality of keywords. The model may include a plurality of sub-models classified by category according to the linguistic characteristics of the keyword. Alternatively, the model may include a plurality of sub-models classified by category according to the state characteristics of the device. Alternatively, the model may include a plurality of sub-models classified according to user characteristics.

6 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention.

3 to 5, the processor 170 generates sentences assuming a state of one electronic device in which a sound is output from the TV itself and no sound is output from the sound bar when the TV is used. However, in the actual electronic device system, it is unknown whether the user intentionally sets the TV sound mode to the TV because he wants to hear the sound from the TV, or whether the user wants to listen to the sound bar but outputs sound to the TV. Accordingly, according to an embodiment of the present invention, as shown in FIG. 6 , it is possible to identify the state of the electronic device according to the current situation based on the user's usage history and the setting history of the electronic device in addition to the actual state value of the TV. have. In this case, the user's usage history includes at least one of a connection history of an external device, an application use history, and a search history, but is not limited thereto. The processor 170 may obtain the user's usage history or the setting history of the electronic device from the storage 140 and receive it from the server, but is not limited thereto.

According to an embodiment of the present invention, the actual state value according to the TV state item is the TV volume is 12, only HDMI[4] and Optical are plugged in in the connected state, and a set-top box and a sound bar are connected to each connector. . In the TV sound mode, the device for outputting sound is set to the TV, so information related to the sound bar is currently unknown. Also, in the connection history of the external device, the sound bar was connected and disconnected on August 7, 2019, and accordingly, the TV sound mode was changed from optical to TV by the system. There is also a history of opening and closing the user manual application on the next day, August 8, 2019. At this time, looking at the application usage or search history, the user searches for 'sound bar' in the user manual application, and selects 'how to reconnect the sound bar', 'output sound from the sound bar', 'weather today', etc. on the portal site. It can be seen that the search

Accordingly, the processor 170 can know that the reason why the TV and the sound bar is disconnected is because the TV sound mode is changed by the system based on the TV status item and the user connection history, and when the status of the electronic device is changed, Based on the history of searching for 'sound bar' by the user using the user manual application in the similar time period, and the history of searching for 'sound bar' and 'how to connect the sound bar' on the server, etc. intention can be inferred.

According to an embodiment of the present invention, the processor 170 accurately extracts the state of the electronic device necessary for the user from among the states of the electronic device defined in the hierarchical structure shown in FIG. 4 based on the state item of the electronic device and the user's intention. can do it

7 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention. According to an embodiment of the present invention, as described in the embodiments related to FIGS. 4 to 6 , the processor 170 shows a state in which a search phrase generated based on the identified state of the electronic device is displayed on the display. . In particular, as shown in FIG. 6 , the processor 170 may generate a search phrase based on the user's usage history, the setting history of the electronic device, etc. in addition to the keyword extracted from the state value of the electronic device.

At least one search phrase may be generated, and for example, a plurality of search phrases such as "Sound bar optical setting method", "Sound bar optical connection method", "Optical sound bar no sound", "Optical sound bar not connected" can be created with

As the search phrases that can be generated using the types and keywords extracted from the identified status items become more diverse, the probability that the search phrases required for the user exist is higher, and the user's convenience can be further increased by providing a user interface to select them. have. Accordingly, when a plurality of search phrases are displayed on the display of the electronic device, the processor 170 receives a user input by a remote control or the like through the interface unit 110 and performs a subsequent operation based on the search phrase selected according to the user input. can do. In this case, the user input may be made through a microphone or the like as well as a remote control button or a touch screen, but is not limited thereto. In addition, although an embodiment of the present invention is implemented as an electronic device having a display, when the electronic device does not have a display, such as a Bluetooth speaker, it is displayed on another display device connected thereto, or a search phrase is outputted in various ways, such as by voice. can be implemented.

8 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention. According to an embodiment of the present invention, when a plurality of search phrases are selected according to a user input or when one search phrase is generated, the processor 170 performs a subsequent operation using the selected or generated search phrase. In this case, the subsequent operation includes performing a search through a user manual application or the web using the generated search phrase. Also, according to another embodiment of the present invention, when a plurality of search phrases are generated, each search result using all of the generated search phrases may be aggregated and displayed.

The processor 170 may display the search results obtained by searching through the application and the web in order of priority based on a predefined priority. In the present embodiment, when the search results are displayed in order of priority, more accurate search results can be provided than simply listing the search results or displaying the search results screen in a specific web portal site as it is. In this case, there are various embodiments of prioritization. For example, when a plurality of search phrases are generated, the processor 170 may display the most searched documents in the order of the respective search results obtained using the plurality of search phrases. In other words, if you search for “how to set up sound bar optical”, documents a, b, c, and d will appear, if you search for “how to connect with sound bar optical”, documents c, d, e will appear, and “optical sound bar does not sound”. When a, b, and d search for “optical sound bar not connected” and documents a and d are found, the processor 170 may prioritize d, a, b, c, e in the order, and By displaying content, including links to documents in sequence, users can use more accurate search results. As another embodiment, the processor 170 may determine the priority by identifying the number of times other users have used the search result through the server. That is, the processor 170 may give priority to the documents a, b, c, d, and e that are found as a result of the search using the search phrase in the order of the highest number of views. In addition to this, priorities may be assigned in various ways, and the present invention is not limited thereto. In addition, even if an optimal result is derived through priorities, the processor 170 may provide a plurality of results determined to be highly relevant, including the corresponding result, in a pop-up form on the display or may guide the result by voice.

In addition, when a learning model is used in the process of deriving a search result, the priority is increased to the document provided the most as a search result of the electronic device status item, user's use history, and other users in a similar situation, and the server periodically By learning this, when providing search results to other users in a similar situation later, documents with high priority are provided preferentially.

9 is a diagram illustrating an operation of an electronic device according to an embodiment of the present invention. According to an embodiment of the present invention, after providing the search result to the user, the processor 170 provides a user interface that asks the user's intention, such as whether the provided search result is suitable for the user's situation or a useful search result. Follow-up operations may be performed accordingly. For example, according to one embodiment, after providing the user interface 'Were the search results helpful?', if the user selects 'Yes', the user returns to the home screen and based on the information obtained through the search result, the user returns to the home screen. The user may reset the use environment or perform another operation, and if the user selects 'No', the search phrase may be regenerated or the process of re-identifying the state of the electronic device may be performed.

As such, if an appropriate search result is not suggested to the user through the user's feedback, information can be provided by performing a series of processes again, and if an appropriate search result is suggested, it is reflected in the learning model to provide more accurate information. You will be able to build your data so that

100: electronics
110: interface unit
120: display unit
130: user input unit
140: storage
150: microphone
160: speaker
170: processor

Claims (20)

In the electronic device, the state of the electronic device is identified according to a state value indicated by a plurality of state items of the electronic device;
generating a search phrase by using a plurality of search keywords obtained based on the identified state of the electronic device;
providing a search result obtained based on the generated search phrase
An electronic device comprising a processor. According to claim 1,
The processor is configured to generate the search phrase based on a model trained to arrange an arrangement order of the plurality of search keywords. 3. The method of claim 2,
The model is an electronic device trained to identify the state of the electronic device according to state values indicated by the plurality of state items. 3. The method of claim 2,
The model is an electronic device trained to obtain the plurality of search keywords based on the identified state of the electronic device. 3. The method of claim 2,
The model is an electronic device in which the search keyword is trained to include similar keywords. According to claim 1,
The processor classifies the plurality of state items by category, and identifies the states of the electronic devices based on information indicating states of the plurality of electronic devices for each state value indicated by the classified plurality of state items. 7. The method of claim 6,
The processor is configured to identify a state of the electronic device based on information corresponding to a current state value among information provided for each of a plurality of state values of the electronic device. According to claim 1,
The processor is an electronic device that generates the search phrase by additionally using the user's usage history. 9. The method of claim 8,
The use history may include at least one of a connection history of an external device, an application use history, and a search history. 9. The method of claim 8,
The processor is
adjusting a weight of a state of a corresponding electronic device among states of a plurality of electronic devices based on the user's usage history;
An electronic device that identifies a state of the electronic device corresponding to the state value based on the adjusted weight. According to claim 1,
The processor is configured to generate the search phrase by additionally using a setting history of the electronic device. According to claim 1,
The processor is configured to provide a search result selected based on a pre-defined priority among the plurality of obtained search results. 13. The method of claim 12,
The priority is an electronic device including the number of times another user searches for the search result. According to claim 1,
The processor is configured to obtain the search result based on a search phrase selected by a user input from among a plurality of search phrases. According to claim 1,
The processor performs a subsequent operation based on a search result selected by a user input from among a plurality of search results. A method for controlling an electronic device, comprising:
identifying a state of the electronic device according to state values indicated by a plurality of state items of the electronic device;
generating a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device; and
and providing a search result obtained based on the generated search phrase. 17. The method of claim 16,
The generating of the search phrase may include generating the search phrase based on a model trained to align an arrangement order of the plurality of search keywords. 17. The method of claim 16,
The step of identifying the state of the electronic device comprises:
classifying the plurality of state items by category;
and identifying states of the electronic devices based on information indicating states of a plurality of electronic devices for each state value indicated by the plurality of classified state items. 17. The method of claim 16,
The generating of the search phrase includes generating the search phrase by additionally using a user's usage history. A computer-readable code, comprising: a computer program storing a code for performing a control method of an electronic device;
identifying a state of the electronic device according to state values indicated by a plurality of state items of the electronic device;
generating a search phrase using a plurality of search keywords obtained based on the identified state of the electronic device; and
and providing a search result obtained based on the generated search phrase.

Images