KR102265406B1 - Server and method for comtrolling the server - Google Patents

Abstract

A server implementing a display device and an interactive system is disclosed. The server generates a communicator for receiving text information corresponding to the user's voice collected from the display device from the display device, extracts utterance elements from the text information, and generates a query for searching content using the extracted utterance elements. and a control unit for controlling to transmit the metadata for the contents to an external server that divides and stores the metadata for each item, wherein the control unit transmits the predetermined item if the content classification criterion in the item corresponding to the extracted utterance element is less than or equal to a predetermined number The query is created by adding it as a content search criterion.

Description

Server and its control method { SERVER AND METHOD FOR COMTROLLING THE SERVER }

The present invention relates to a server and a control method thereof, and more particularly, to a server constituting an interactive system and a control method thereof.

With the development of electronic technology, various types of display devices have been developed and distributed, and have gradually been provided with various functions according to the needs of users. In particular, in the case of a TV, it is recently connected to the Internet to support Internet services, and users can watch a large number of digital broadcasting channels through the TV.

On the other hand, recently, in order to control the display device more conveniently and intuitively, a technology for controlling the display device through the user's voice has been developed. In particular, in the case of a TV, it is possible to recognize a user's voice and perform a function corresponding to the user's voice, such as adjusting a volume or changing a channel.

However, in the related art, there is a limitation in that the content cannot be searched and provided to the user according to the user's voice.

An object of the present invention is to provide a server capable of efficiently retrieving content when configuring an interactive system through the server and a method for controlling the same.

A display device and a server implementing an interactive system according to an embodiment of the present invention for achieving the above object include a communication unit for receiving text information corresponding to a user's voice collected by the display device from the display device; , extracting a speech element from the text information, generating a query for searching content using the extracted speech element, and controlling to transmit the metadata about the content to an external server that classifies and stores the content by item; and the control unit generates the query by adding a preset item as a content search criterion when the number of content classification criteria in the items corresponding to the extracted utterance element is less than or equal to a preset number;

Here, the server according to the present embodiment further includes a storage unit for storing information on the content classification criterion in each item, and the control unit corresponds to the extracted speech element based on the information on the content classification criterion. It may be determined whether the content classification criteria in the selected items are equal to or less than a preset number.

Also, the controller may determine the preset item to be added as the content search criterion based on user preference information.

In addition, when the content search is not performed by the query generated by adding the preset item as the content search criterion, the control unit may regenerate a query for searching content using the extracted speech element. have.

Meanwhile, the items for which the content classification criterion is less than or equal to a preset number may be at least one of a broadcast type item and a quality item.

Also, the preset item may be at least one of a broadcast time item and a broadcast channel item.

On the other hand, the control method of a server implementing an interactive system with a display device according to an embodiment of the present invention includes the steps of receiving text information corresponding to a user's voice collected by the display device from the display device, the text information extracting utterance elements from , generating a query for searching content by using the extracted utterance elements, and transmitting the generated query to an external server that classifies and stores metadata for content by item and, in the generating, when the number of content classification criteria in the items corresponding to the extracted utterance element is less than or equal to a preset number, the query is generated by adding a preset item as a content search criterion.

Here, in the generating, it may be determined whether the number of content classification criteria in the item corresponding to the extracted utterance element is less than or equal to a preset number based on pre-stored information on the content classification criterion.

Also, in the generating, the preset item to be added as the content search criterion may be determined based on user preference information.

And, in the generating step, when the content search is not performed by the query generated by adding the preset item as the content search criterion, regenerating a query for searching content using the extracted speech element can do.

Meanwhile, the items for which the content classification criterion is less than or equal to a preset number may be at least one of a broadcast type item and a quality item.

Also, the preset item may be at least one of a broadcast time item and a broadcast channel item.

According to various embodiments of the present invention as described above, when content is searched only with utterance elements extracted from the user's voice, it is possible to solve a problem in that a lot of content is searched and the efficiency of content search may be lowered. In addition, the user who uses the interactive system may be provided with a content search result that matches his/her intention of uttering while reducing the number of conversations with the display device, so that convenience may be improved.

1 is a diagram for explaining an interactive system according to an embodiment of the present invention;
2 is a block diagram of a display device according to an embodiment of the present invention;
3 is a block diagram of a first server according to an embodiment of the present invention;
4 is a block diagram of a second server according to an embodiment of the present invention;
5 is a diagram illustrating an example of structured metadata according to an embodiment of the present invention;
Figure 6 is a block diagram for explaining the detailed configuration of the second server shown in Figure 4;
7 is a view for explaining an example of a method of adding a content search criterion according to an embodiment of the present invention;
8 to 9 are diagrams illustrating an example of a UI screen provided by a display device according to an embodiment of the present invention, and
10 is a flowchart illustrating a method for controlling a server according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a diagram for explaining an interactive system according to an embodiment of the present invention. As shown in FIG. 1 , the interactive system 1000 includes a display device 100 , a first server 200 , a second server 300 , and an external server 400 . Here, the second server 300 may be referred to as an interactive interface device.

The display apparatus 100 may be controlled by a remote controller (not shown) for controlling the display apparatus 100 . Specifically, the display apparatus 100 may perform an operation corresponding to a remote control control signal received from a remote control (not shown). For example, when the display apparatus 100 is implemented as a TV as shown in FIG. 1 , the display apparatus 100 performs power on/off, channel switching, volume control, etc. according to a remote control control signal received from a remote control (not shown). can perform the function of

Also, the display apparatus 100 may perform various operations corresponding to the user's voice.

Specifically, the display apparatus 100 may perform a function corresponding to the user's voice or output a system response corresponding to the user's voice.

To this end, the display apparatus 100 transmits the collected user's voice to the first server 200 . When the user's voice is received from the display apparatus 100 , the first server 200 converts the received user's voice into text information (ie, text) and transmits the text information to the display apparatus 100 .

Then, the display apparatus 100 transmits the text information received from the first server 200 to the second server 300 . When text information is received from the display apparatus 100 , the second server 300 generates response information corresponding to the received text information and transmits it to the display apparatus 100 .

The display apparatus 100 may perform various operations based on response information received from the second server 300 . Here, the response information may include a control command for the display apparatus 100 to perform a specific function and various information related to a system response output from the display apparatus 100 .

Specifically, the display apparatus 100 may perform a function corresponding to the user's voice. That is, the display apparatus 100 may perform a function corresponding to the user's voice among functions that can be provided by the display apparatus 100 . For example, when a user's voice for channel switching is input to the display apparatus 100 , the second server 300 may transmit a control command for switching the channel of the display apparatus 100 to the display apparatus 100 . have. Accordingly, the display apparatus 100 may switch channels based on the received control command.

Also, the display apparatus 100 may output a system response corresponding to the user's voice. Here, the system response may be output in the form of at least one of a voice and a UI screen.

For example, when a user's voice requesting a search for a broadcast program is input to the display apparatus 100 , the second server 300 searches for content that matches the intention of the utterance, and transmits the search result to the display apparatus 100 . can be transmitted Accordingly, the display apparatus 100 may display a UI screen including a list of contents searched for according to the utterance intention.

As such, the display apparatus 100 may perform various operations corresponding to the user's voice based on the response information received from the second server 300 .

Meanwhile, when the user's utterance intention is related to content search, the second server 300 searches for content matching the user's utterance intention through the external server 400 and transmits the search result to the display device 100 . can

Here, the external server 400 may structure and store the metadata. For example, the external server 400 may be implemented as a metadata server that structures and stores metadata information for EPG, Music, VOD, Photo, Application, and the like.

Specifically, the external server 400 may classify the metadata for the content for each item (or field), and structure and store the metadata for the content according to the content classification criteria in each item. Here, the item is an attribute for classifying metadata for content, and the content classification criterion may be a detailed attribute for classifying content within each field. For example, when the item is a broadcast type, the content classification criterion may be an attribute capable of subdividing the broadcast type, such as rebroadcast or main broadcast. As another example, when the item is picture quality, the content classification criterion may be an attribute capable of subdividing picture quality, such as high definition (HD) and standard definition (SD).

Specifically, the second server 300 may extract utterance elements from text information and generate a query for content search using the extracted utterance elements. At this time, if the content classification criterion in the item corresponding to the extracted utterance element is less than or equal to the preset number, the second server 300 generates a query by adding the preset item as the content search criterion and transmits it to the external server 400 . have.

For example, it is assumed that the user utters "find a rebroadcast program". In this case, the second server 300 extracts "rebroadcast" from the received text information as a speech element related to the broadcast type, and determines the content classification criterion for the broadcast type from the structured metadata stored in the external server 400 do. Since the broadcast type is divided into two content classification criteria, such as rebroadcast and main broadcast, the second server 300 may generate a query for content search by adding a broadcast channel currently viewed by the user as a content search criterion.

Accordingly, according to the query received from the second server 300, the external server 400 searches for a broadcast program provided from a broadcast channel currently viewed by the user among rebroadcasts, and information on the searched broadcast program (eg, title) , performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, broadcast channel, and at least one of a thumbnail) may be transmitted to the second server 300 . When a search result corresponding to the user's voice is received from the external server 400 , the second server 300 displays response information for outputting a system response corresponding to the user's voice on the display device 100 on the display device 100 . ) can be transmitted. Accordingly, the display apparatus 100 may output a list of broadcast programs provided by a broadcast channel currently viewed by the user during rebroadcast in response to a system response to the user's voice such as "find a rebroadcast program".

As such, the server according to an embodiment of the present invention can generate a query by adding the preset item as a content search criterion if the content classification criteria in the item corresponding to the utterance element extracted from the text information is less than or equal to the preset number. have. Accordingly, it is possible to solve a problem in that, when content is searched using only the utterance elements extracted from the user's voice, a lot of content is searched and the efficiency of content search is lowered.

Meanwhile, although the display device 100 is illustrated as a TV in FIG. 1 , this is only an example. That is, the display device 100 may be implemented in various electronic devices such as a mobile phone such as a smart phone, a desktop PC, a notebook computer, and a navigation device as well as a TV.

Also, although it is illustrated that the first server 200 and the second server 300 are implemented as separate servers in FIG. 1 , this is also only an example. That is, of course, it can be implemented as one interactive server including the first server 200 and the second server 300 . In this case, the display apparatus 100 transmits the user's voice to the interactive server, the interactive server converts the user's voice received from the display apparatus 100 into text information, and uses the converted text information to Content matching the intention of the utterance may be searched. In this case, if the content classification criteria in the items corresponding to the utterance elements extracted from the text information are less than or equal to the preset number, the interactive server may generate a query by adding the preset items as the content search criteria. Accordingly, when implemented as one interactive server including the first server 200 and the second server 300 , the display apparatus 100 may transmit the user's voice to the interactive server.

2 is a block diagram of a display device according to an embodiment of the present invention. As shown in FIG. 2 , the display apparatus 100 includes an output unit 110 , a voice collection unit 120 , a first communication unit 130 , a second communication unit 135 , a storage unit 140 , a receiving unit 150 , and a signal. It may include a processing unit 160 , a remote control signal receiving unit 171 , an input unit 173 , an interface unit 175 , and a control unit 180 .

Although FIG. 2 illustrates various components that may be included in the display apparatus 100 , the display apparatus 100 does not necessarily include all components, and is not limited to having only these components. That is, it goes without saying that some of the components may be omitted or added according to the product type of the display apparatus 100 , or may be replaced with other components.

The output unit 110 outputs at least one of an audio and an image. Specifically, the output unit 110 may output a system response corresponding to the user's voice collected through the voice collection unit 120 in the form of at least one of a voice and a UI screen.

Here, on the UI screen, a system response corresponding to the user's voice may be expressed in a text format, or a search result searched according to the user's voice may be expressed in a list format.

To this end, the output unit 110 may include a display unit 111 and an audio output unit 113 .

Specifically, the display unit 111 may be implemented as a liquid crystal display (LCD), an organic light emitting diode (OLED), a plasma display panel (PDP), or the like.

The display unit 111 may provide various display screens that can be provided through the display apparatus 100 . In particular, the display unit 111 may configure and display a system response corresponding to the user's voice as a UI screen.

Meanwhile, the audio output unit 113 may be implemented as an output port such as a jack or a speaker, and may output a system response corresponding to the user's voice in the form of a voice.

Also, the output unit 110 may output various contents. Here, the content may include broadcast content, VOD content, and the like. For example, the display unit 111 may output an image constituting the content, and the audio output unit 113 may output audio constituting the content.

The voice collection unit 120 collects the user's voice. For example, the voice collecting unit 120 may be implemented as a microphone for collecting the user's voice, and may be built into the display device 100 to form an integral body, or may be implemented as a separate form from the display device 100 . When implemented in a separate form, the voice collection unit 120 may be implemented in a form that the user holds in his/her hand or may be placed on a dining table or table, and is connected to the display device 100 through a wired or wireless network. Thus, the collected user's voice may be transmitted to the display apparatus 100 .

Meanwhile, the voice collection unit 120 may determine whether the collected voice is the user's voice, and may filter noise (eg, air conditioner sound, vacuum cleaner sound, music sound, etc.) from the user's voice.

For example, when an analog user voice is input, the voice collection unit 120 samples it and converts it into a digital signal. Then, the voice collecting unit 120 calculates the energy of the converted digital signal, and determines whether the energy of the digital signal is equal to or greater than a preset value.

When the energy of the digital signal is equal to or greater than a preset value, the voice collection unit 120 removes a noise component from the digital signal and transmits the noise component to the first communication unit 130 . In this case, the noise component is a sudden noise that may occur in the home environment, and may include a sound of an air conditioner, a sound of a vacuum cleaner, a sound of music, and the like. On the other hand, when the energy of the digital signal is less than a preset value, the voice collecting unit 120 waits for another input without performing any special processing on the digital signal.

Accordingly, since the entire audio processing process is not activated by a sound other than the user's voice, unnecessary power consumption can be prevented.

The first communication unit 130 communicates with the first server (200 in FIG. 1 ). Specifically, the first communication unit 130 may transmit the user's voice to the first server 200 and receive text information corresponding to the user's voice from the first server 200 .

The second communication unit 135 performs communication with the second server (300 in FIG. 1 ). Specifically, the second communication unit 135 may transmit the received text information to the second server 300 and receive response information corresponding to the text information from the second server 300 .

To this end, the first communication unit 130 and the second communication unit 135 may communicate with the first server 200 and the second server 300 using various communication methods.

For example, the first communication unit 130 and the second communication unit 135 are wired/wireless local area network (LAN), WAN, Ethernet, Bluetooth, Zigbee, USB (Universal Serial Bus), IEEE 1394, Wi-Fi, etc. may be used to communicate with the first server 200 and the second server 300 . To this end, the first communication unit 130 and the second communication unit 135 may include chips or input ports corresponding to each communication method. For example, when communication is performed in a wired LAN method, the first communication unit 130 and the second communication unit 135 may include a wired LAN card (not shown) and an input port (not shown).

Meanwhile, in the above-described embodiment, it has been described that the display apparatus 100 includes separate communication units 130 and 135 in order to communicate with the first server 200 and the second server 300 , but this is not the case. just an example That is, of course, the display apparatus 100 may communicate with the first server 200 and the second server 300 through one communication module.

Also, in the above-described embodiment, the first communication unit 130 and the second communication unit 135 have been described as performing communication with the first server 200 and the second server 300, but this is only an example. . That is, the first communication unit 130 and the second communication unit 135 may be connected to a web server (not shown) to perform web browsing.

The storage unit 140 is a storage medium in which various programs necessary for operating the display apparatus 100 are stored, and may be implemented as a memory, a hard disk drive (HDD), or the like. For example, the storage 140 may include a ROM for storing a program for performing an operation of the controller 180 , a RAM for temporarily storing data according to an operation of the controller 180 , and the like. In addition, an EEROM (Electrically Erasable and Programmable ROM) for storing various reference data may be further provided.

The receiver 150 receives various contents. Here, the content may include broadcast content, VOD content, and the like.

Specifically, the receiver 150 may receive content from a broadcasting station that transmits a broadcast program using a broadcasting network or a web server that transmits a content file using the Internet.

* In the case of receiving content from a broadcasting station, the receiver 150 may be implemented in a form including a tuner (not shown), a demodulator (not shown), an equalizer (not shown), and the like. On the other hand, in the case of receiving content from a source such as a web server, the receiver 150 may be implemented as a network interface card (not shown).

As such, the receiver 150 may be implemented in various forms according to embodiments.

The signal processing unit 160 performs signal processing on the content so that the content received through the receiving unit 150 or the interface unit 175 can be output through the output unit 110 .

Specifically, the signal processing unit 160 may perform operations such as decoding, scaling, and frame rate conversion on an image included in the content to convert the image into a form that can be output by the display unit 111 . Also, the signal processing unit 160 may perform signal processing such as decoding on the audio signal included in the content to convert the audio signal into a form that can be output by the audio output unit 113 .

The remote control signal receiving unit 171 receives a remote control control signal from an external remote control. The controller 180 may execute various operations based on the remote control control signal received by the remote control signal receiver 171 . For example, the controller 180 may execute functions such as power on/off, channel change, volume control, etc. according to a control signal received through the remote control signal receiver 171 .

The input unit 173 receives various user commands. The controller 180 may execute an operation corresponding to a user command input from the input unit 173 . For example, the controller 180 may execute power on/off, channel change, volume control, etc. according to a user command input from the input unit 173 .

To this end, the input unit 173 may be implemented as an input panel. The input panel may be formed of a touch pad or a keypad having various function keys, number keys, special keys, character keys, or the like, or a touch screen type.

The interface unit 175 communicates with an external device (not shown). Here, the external device (not shown) may be implemented as various types of electronic devices to transmit content to the display device 100 . For example, when the display device 100 is implemented as a TV, an external device (not shown) is connected to the display device 100 such as a mobile phone, a set-top box, a DVD player, a Blu-ray disc player, a game machine, and the like to perform a function. It can be implemented with various types of electronic devices that can do this.

For example, the interface unit 175 may communicate with an external device (not shown) according to various wired communication methods such as HDMI and USB or wireless communication methods such as Bluetooth and Zigbee. To this end, the interface unit 175 may include a chip or an input port corresponding to each communication method. For example, when performing communication with an external device (not shown) according to the HDMI communication method, the interface unit 175 may include an HDMI port.

The controller 180 controls the overall operation of the display apparatus 100 . That is, the control unit 180 includes the output unit 110 , the voice collection unit 120 , the first communication unit 130 , the second communication unit 135 , the storage unit 135 , the receiving unit 150 , and the signal processing unit 160 . , the operation of the remote control signal receiving unit 171 , the input unit 173 , and the interface unit 175 can be controlled. The controller 180 may include a central processing unit (CPU) and a module for controlling the display apparatus 100 and a read only memory (ROM) and random access memory (RAM) for storing data.

Specifically, the controller 180 may control the first communication unit 130 to collect the user's voice through the voice collection unit 120 and transmit the collected user's voice to the first server 300 . In addition, when text information corresponding to the user's voice is received, the controller 180 may control the second communication unit 135 to transmit the received text information to the second server 300 .

Meanwhile, when response information corresponding to the user's voice is received from the second server 300 , the controller 180 may perform various operations based on the received response information.

Specifically, the controller 180 may execute a function corresponding to the user's voice based on the received response information.

To this end, the response information may include a control command for controlling the function of the display apparatus 100 . Here, the control command may include a command for executing a function corresponding to a user's voice among functions executable on the display apparatus 100 . Accordingly, the controller 180 may control each component of the display apparatus 100 to execute a function corresponding to the user's voice based on the control command received from the second server 300 .

For example, when the display device 100 implemented as a TV collects a user's voice saying "Play number ○ (channel number)", the second server 300 displays "Play number ○ (channel number)". It is determined that the utterance intention included in the user's voice is to request a channel change to ○ (channel number), and a control command for changing the channel to ○ (channel number) according to the determined utterance intention is transmitted to the display device ( 100) can be transmitted. Accordingly, the controller 180 may control to tune the channel ○ (channel number) based on the received control command and output the content provided through the selected channel.

However, this is only an example, and the controller 180 turns on/off the power according to the collected user's voice. Each component of the display apparatus 100 may be controlled to perform various operations such as volume control.

Also, the response information may include various information related to a system response output from the display apparatus 100 . In this case, the response information may further include a control command for outputting a system response corresponding to the user's voice.

Specifically, when the user's voice having an utterance intention for content search is collected by the display apparatus 100 , the second server 300 determines the user's utterance intention and searches for content matching the determined utterance intention. can do. In addition, the second server 300 transmits at least one of information about the searched content, such as title, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, broadcast channel, and thumbnail, to the display device 100 . can

In this case, the controller 180 may output a system response corresponding to the user's voice in the form of at least one of a voice and a UI screen using the received information. In the above-described example, the controller 180 may generate a list of contents by using information about the contents received from the second server 300 , and may output a UI screen including the generated list. In this case, the controller 180 may add at least one of a title, a performer, a producer, a genre, a broadcast type, a broadcast time, a picture quality, a viewing rating, a broadcast channel, and a thumbnail for the searched content to the list.

Meanwhile, the response information may include system response information in which a system response output from the display apparatus 100 is expressed in a text format. Accordingly, the controller 180 may control the output unit 110 to output a system response corresponding to the user's voice in the form of at least one of a voice and a UI screen using the received response information.

For example, the controller 180 may convert system response information expressed in a text format into voice using a text to speech (TTS) engine and output the converted system response information through the audio output unit 113 . Here, the TTS engine is a module for converting text into speech, and may convert text into speech using various conventionally disclosed TTS algorithms. Also, the control unit 150 may configure the UI screen to include text constituting the system response information and output it through the display unit 110 .

Meanwhile, the controller 180 may analyze the user preference information and store the user preference information in the storage unit 140 . Specifically, whenever a power-on or channel switching command is input, the controller 180 determines the content provided from the selected channel based on the EPG information, and determines the title, performer, producer, genre, broadcast for the determined content. Information on at least one of a type, a broadcast time, a picture quality, a viewing rating, and a broadcast channel may be stored. And, whenever a power-on or input terminal change command is input, the controller 180 determines the content provided from an external device (not shown) connected to the interface unit 175, and determines the content for the determined content, including titles, performers, Information on at least one of a producer, a genre, a broadcast type, a broadcast time, an image quality, a viewing rating, and a broadcast channel may be stored. To this end, the controller 180 may request transmission of information on content stored in an external device (not shown).

In addition, the controller 180 controls the title, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, and broadcast channel for the content viewed more than a preset number of times, the user's preferred channel, performer, producer, genre, The broadcast type, broadcast time, picture quality, viewing rating, and broadcast channel may be determined and stored in the storage unit 140 . In addition, when a request command for user preference information is received from the second server 300 , the controller 180 may transmit the user preference information to the second server 300 .

However, this is only an example, and the controller 180 may display a UI screen for receiving user preference information according to a preset event and store the user preference information input through the UI screen in the storage unit 140 .

Meanwhile, the controller 180 may transmit information on a channel that the user is currently watching to the second server 300 . For example, when a request command is received from the second server 300 , the controller 180 determines a currently tuned channel through the receiver 150 and transmits information on the determined channel to the second server 300 . can

3 is a block diagram of a first server according to an embodiment of the present invention. As shown in FIG. 3 , the first server 200 includes a communication unit 210 and a control unit 220 .

The communication unit 210 communicates with the display apparatus 100 . Specifically, the communication unit 210 may receive the user's voice from the display apparatus 100 and transmit text information corresponding to the user's voice to the display apparatus 100 . To this end, the communication unit 210 may include various communication modules.

The controller 220 controls the overall operation of the first server 200 . In particular, when a user's voice is received from the display apparatus 100 , the controller 220 controls the communication unit 210 to generate text information corresponding to the user's voice and transmit it to the display apparatus 100 .

Specifically, the controller 220 may generate text information corresponding to the user's voice by using a Speech to Text (STT) engine. Here, the STT engine is a module for converting a voice signal into text, and may convert the voice signal into text using various STT algorithms disclosed in the prior art.

For example, the controller 220 determines the voice section by detecting the beginning and the end of the voice uttered by the user in the received voice of the user. Specifically, the controller 220 may calculate the energy of the received voice signal, classify the energy level of the voice signal according to the calculated energy, and detect the voice section through dynamic programming. In addition, the controller 220 generates phoneme data by detecting a phoneme, which is a minimum unit of speech, based on an acoustic model within the detected speech section, and uses the generated phoneme data with a Hidden Markov Model (HMM) probability model. can be applied to convert the user's voice into text.

4 is a block diagram of a second server according to an embodiment of the present invention. As shown in FIG. 4 , the second server 300 includes a communication unit 310 and a control unit 320 .

The communication unit 310 communicates with the display apparatus 100 . Specifically, the communication unit 310 may receive text information corresponding to the user's voice collected by the display apparatus 100 from the display apparatus 100 . In addition, the communication unit 310 may transmit response information corresponding to the received text information to the display apparatus 100 .

Also, the communication unit 310 communicates with an external server ( 400 in FIG. 1 ). Specifically, the communication unit 310 may transmit a query for content search to the external server 400 , and receive a result of the search from the external server 400 .

To this end, the communication unit 310 may include various communication modules. For example, the communication unit 310 may include wired/wireless local area network (LAN), ethernet, Bluetooth, Zigbee, Universal Serial Bus (USB), IEEE 1394, Wi-Fi, etc. Communication may be performed with the display apparatus 100 and the external server 400 through the communication method. To this end, the communication unit 310 may include a chip or an input port corresponding to each communication method. For example, when communication is performed using a wired LAN method, the communication unit 310 may include a wired LAN card (not shown) and an input port (not shown).

However, this is only an example, and the communication unit 310 may include a separate communication module for performing communication with each of the display apparatus 100 and the external server 400 .

The controller 320 controls the overall operation of the second server 300 . In particular, the controller 320 may extract a utterance element from text information, generate a query for searching content using the extracted utterance element, and transmit it to the external server 400 . Here, the external server 400 may classify and store metadata for content for each item.

Specifically, when text information is received from the display apparatus 100 , the controller 320 may extract a utterance element from the text information and determine the user's utterance intention by using the extracted utterance element.

For example, it is assumed that text information such as “find a rebroadcast program” is received from the display apparatus 100 . In this case, the controller 320 may extract the term “rebroadcast program”, which is an utterance element related to a broadcast type, from text information such as “find a rebroadcast program” by using a pre-stored keyword. Then, the control unit 320 determines that the term "find me" corresponds to a search request using the pre-stored keyword, and the utterance intention of "find a rebroadcast program" is to request a search for a rebroadcast program. can

As such, when the user's utterance intention is related to content search, the controller 320 may generate a query for content search by using the extracted utterance element. In this case, the controller 320 determines an item to which the extracted utterance element is mapped from the structured metadata stored in the external server 400 and a content classification criterion of the corresponding item.

Then, the control unit 320 determines the effectiveness of the search attribute of the extracted speech element based on the content classification criterion of the item to which the extracted speech element is mapped (attributes effectiveness check). Specifically, the controller 320 determines whether the number of content classification criteria in the item to which the extracted utterance element is mapped is a preset number, and if the number of content classification criteria is less than or equal to the preset number, the extracted utterance element is used as a search condition. may be judged to be inappropriate. Here, the preset number may be two, but is not limited thereto.

When it is determined that the extracted speech element is inappropriate as a search condition, the controller 320 generates a query by adding at least one of semantically orthogonal attributes to the extracted speech element as a content search criterion. can Here, semantically independent attributes may be preset as attributes that do not impair the user's utterance intention for content search.

Specifically, if the number of content classification criteria in the items corresponding to the extracted utterance elements is less than or equal to the preset number, the controller 320 may generate a query by adding the preset items as the content search criteria.

Here, the item for which the content classification criterion is less than or equal to a preset number may be at least one of a broadcast type item and a quality item. Also, the preset item may be at least one of a broadcast time item and a broadcast channel item.

* Hereinafter, for a more detailed description, it is assumed that the external server 400 structures and stores the metadata as shown in FIG. 5 .

First, the external server 400 may classify the metadata for the content for each item. Here, the items are various content information included in the metadata, and the external server 400, as shown in FIG. 5, includes items such as title, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, and broadcast channel. Metadata can be stored by dividing it into .

In addition, the external server 400 may structure and store the metadata for the content according to the content classification criteria in each item.

For example, as shown in FIG. 5 , the external server 400 classifies the metadata for the content by using the title item 510 in which the metadata for the content is classified using the title as the content classification criterion, and the performer as the content classification criterion. One performer item 520, a producer item 530 in which metadata for content is classified using a creator as a content classification criterion, a genre item 540 in which metadata for content is classified using a genre as a content classification criterion, broadcast A broadcast type item 550 in which metadata for content is classified using type as a content classification criterion, a broadcast time item 560 in which metadata for content is classified by using broadcast time as a content classification criterion, and image quality as a content classification criterion The quality item 570, which divided the metadata for the content, as the viewer rating item 580, which divided the metadata for the content by using the viewer rating as the content classification criterion, and the broadcasting channel as the content classification criterion for the content. The metadata for the content may be structured and stored by dividing the metadata into the divided viewing rating items 590 .

However, this is only an example, and it goes without saying that the external server 400 may structure and store the metadata using information on various contents constituting the metadata.

Hereinafter, when the external server 400 structures and stores metadata as shown in FIG. 5 , a method of generating a query for content search in the control unit 320 will be described.

For example, when text information such as "Find a rebroadcast program" is received from the display apparatus 100, the controller 320 may extract "rebroadcast program" as a speech element from "Find a rebroadcast program".

In this case, "rebroadcast program" is a speech element related to a broadcast type, and an item mapped in the structured metadata corresponds to the broadcast type item 550 . Accordingly, the controller 320 checks the number of content classification criteria in the broadcast type item 550 in the structured metadata.

Since the broadcast type item 550 is divided into main broadcast and rebroadcast, that is, two content classification criteria, the control unit 320 determines that the number of content classification criteria in the item to which the extracted speech element is mapped is less than or equal to a preset number, It may be determined that the extracted speech element is inappropriate as a search condition.

As such, when the number of content classification criteria in the item to which the extracted utterance elements are mapped is less than or equal to a preset number, it is determined that the extracted utterance elements are inappropriate as a search condition. This is because the efficiency of content retrieval is lowered.

Accordingly, the controller 320 may generate a query for content search by adding a preset item as a content search criterion. Specifically, the controller 320 may set a search condition value in a preset item, and generate a query for content search using the set search condition value and the extracted utterance element.

Here, the preset item may be at least one of a broadcast time item and a broadcast channel item.

Meanwhile, a condition value set for each preset item may be preset for each item. For example, in the case of a broadcast time item, a condition value may be preset as content that is broadcast within a preset time (eg, 24 hours) from the current time, and in the case of a broadcast channel item, the content is broadcast on the channel currently viewed by the user. A condition value may be preset as content.

Accordingly, when a broadcast time item is added as a content search criterion, the controller 320 may set a content broadcast within a preset time from the current time for the broadcast time item as a condition value. In addition, the controller 320 may generate a query for searching for content whose broadcast time is within 24 hours and the broadcast type is rebroadcast, and may transmit the generated query to the external server 400 .

Accordingly, the external server 400 may perform a content search using the query received from the second server 300 and transmit the search result to the second server 300 . In this case, the external server 300 transmits information about the searched content (eg, at least one of title, thumbnail, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, broadcast channel, etc.) as a search result. have. For example, when the current time is 10 o'clock on January 7th, the external server 400 may transmit Title_BBB and Title_CCC, which are title information for the searched content, using the structured metadata as shown in FIG. 5 .

On the other hand, when a broadcast channel item is added as a content search criterion, the controller 320 may set information on a channel currently viewed by the user as a condition value for the broadcast channel item. To this end, the controller 320 may request information on a channel currently selected from the display apparatus 100 and receive information on a channel that the user is currently watching. Accordingly, when the display apparatus 100 is currently tuning in to CH22, the control unit 320 generates a query for searching for content whose broadcast channel is CH22 and the broadcast type is rebroadcast, and sends the generated query to the external server 400 ) can be transmitted.

Accordingly, the external server 400 may perform a content search using the query received from the second server 300 and transmit the search result to the second server 300 . In this case, the external server 300 transmits information about the searched content (eg, at least one of title, thumbnail, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, broadcast channel, etc.) as a search result. have. For example, the external server 400 may transmit Title_III, which is title information for the searched content, by using the structured metadata as shown in FIG. 5 .

Meanwhile, as described above, adding a broadcast channel item or a broadcast time item as an additional condition for content search is in order not to impair the user's utterance intention for content search. That is, in the above example, since the user's utterance intention was simply a search request for a rebroadcast program, when items such as title, performer, producer, genre, etc. are set as additional conditions, there is a risk of damaging the user's utterance intention. Accordingly, a broadcast channel item or a broadcast time item, which is less likely to impair the user's utterance intention, is added.

Meanwhile, the controller 320 may generate response information using the search result received from the external server 400 , and transmit the generated response information to the display apparatus 100 .

Here, the response information may include various information related to a system response output from the display apparatus 100 . In this case, the response information may further include a control command for outputting a system response corresponding to the user's voice.

As in the above example, when "find a rebroadcast program" is collected from the display device 100 , the controller 320 controls the content information (eg, title, thumbnail, performer, producer) received from the external server 400 . , at least one of a genre, a broadcast type, a broadcast time, an image quality, a viewing rating, a broadcast channel, etc.) may be transmitted to the display apparatus 100 . In this case, the controller 320 may transmit a control command for outputting a content list to the display apparatus 100 using information on the content.

Accordingly, the display apparatus 100 may output a system response corresponding to the user's voice based on the response information received from the second server 300 . That is, the display apparatus 100 may output a UI screen in which a list of searched contents is configured in response to a user's voice for searching for contents. In this case, the display apparatus 100 adds information about the searched content (eg, at least one of title, thumbnail, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, broadcast channel, etc.) to the list. can

In the above-described example, the display apparatus 100 may output a list consisting of content BBB and content CCC or a list consisting of content III in response to a user's voice saying “find a rebroadcast program”.

As described above, according to an embodiment of the present invention, when the extracted utterance element is not suitable as a search condition, it is possible to perform a content search by automatically adding it as a content search criterion.

Meanwhile, in the above example, the case where the item mapped to the extracted speech element is a broadcast type item has been described, but this is only an example. That is, since the quality item 570 is divided into HD and SD, that is, two content classification criteria, when a speech element related to image quality is extracted, it may be determined that the extracted speech element is inappropriate as a search condition.

Also, in the above example, it has been described that one preset item is added as a content search criterion, but this is only an example. That is, the controller 320 may add a plurality of preset items as content search criteria. Specifically, the controller 320 may set a condition value in each of the broadcast time item and the broadcast channel item, and may generate a query for content search using a plurality of set intertidal values and the extracted utterance elements.

Also, in the above example, it has been described that a preset item is added as a content search criterion, but this is only an example. That is, the controller 320 may determine a preset item to be added as a content search criterion based on user preference information. Here, the user preference information may include at least one of a user's preferred channel, a performer, a producer, a genre, a broadcast type, a broadcast time, a picture quality, a viewing rating, and a broadcast channel. In this case, the user preference information may be received from the display apparatus 100 .

As an example, it is assumed that the genre preferred by the user is a movie. In this case, the controller 320 may determine a genre item as a content search criterion to be added, and generate a query for content search using the determined content search criterion. That is, in the above example, the control unit 320 sets a movie as a condition value for the genre item, generates a query for searching for content whose genre is a movie and a broadcast type is rebroadcast, and sends the generated query to an external server ( 400) can be transmitted. Accordingly, the external server 400 may transmit Title_HHH, which is title information for the searched content, using the structured metadata as shown in FIG. 5 .

In addition, in the above-described example, when the extracted utterance element is not suitable as the search criterion, it has been described that the content search is performed by automatically adding it as the content search criterion, but this is only an example. That is, the controller 320 may inquire whether to add the content search criterion to the user and determine whether to add the content search criterion based on the user's answer.

Specifically, when the extracted utterance element is inappropriate as a search criterion, the control unit 320 generates response information for outputting a question as to whether to add a content search criterion in the display apparatus 100 as a system response to the display apparatus 100 . ) can be transmitted.

In this case, the controller 320 may express the system response output from the display apparatus 100 in a text format and transmit it to the display apparatus 100 . For example, the controller 320 may express "the condition you mentioned is not suitable for searching. Would you like to search for it by suggesting a broadcast time?" in text format and transmit it to the display apparatus 100 .

Accordingly, the display apparatus 100 may output a question about whether to add a content search criterion as a system response based on the response information received from the second server 300 . For example, the display apparatus 100 may output a UI screen including "The condition you mentioned is not suitable for searching. Would you like to search for it by suggesting a broadcast time?"

Then, the controller 320 may then perform a content search by adding a content search condition based on the received text information. For example, when text information such as "Yes" is received, the controller 320 determines that the term "Yes" corresponds to an affirmative meaning based on a pre-stored keyword, and adds a preset item as a content search condition to the content. You can do a search. On the other hand, when text information such as "no" is received, the controller 320 determines that the term "no" corresponds to a negative meaning based on a pre-stored keyword, and the utterance extracted without adding it as a content search condition Content search can be performed using only the element.

Also, in the above-described example, it has been described that the extracted utterance element is automatically added as a content search criterion when it is not suitable as a search criterion, but this is only an example. That is, when there is no content to be searched for according to the extracted utterance elements, the controller 320 may perform a content search using only a portion of the extracted utterance elements.

For example, it is assumed that text information such as “Find a rebroadcast program that can be viewed by any age on channel 7” is received from the display apparatus 100 . In this case, the controller 320 extracts the term “channel 7”, which is an utterance element related to the broadcast channel, from text information such as “find a rebroadcast program that can be viewed by any age on channel 7” by using a pre-stored keyword. and extracting the term “any age” as an utterance element related to the audience rating, and extracting the term “rebroadcast program” as an utterance element related to a broadcast type. Accordingly, the controller 320 may determine that the utterance intention of “find all age-viewable rebroadcast programs on channel 7” is to request a search for all-age-viewable rebroadcast programs on channel 7 .

In this case, the controller 320 may generate a query for content search by using the extracted speech element. In the above-described example, the control unit 320 may generate a query for searching for content with a broadcast channel of CH7, an audience rating of any age, and a broadcast type of rebroadcast, and transmit the generated query to the external server 400 .

However, when the external server 400 has the structured metadata as shown in FIG. 5 , in that there is no content satisfying the query received from the second server 300 , the external server 400 does not display the search result. A non-existent response may be transmitted to the second server 300 .

In this case, the controller 320 may re-generate a query for content search by using only a portion of the extracted utterance elements. Specifically, the controller 320 may remove the extracted speech elements corresponding to at least one of the broadcast time type and the broadcast channel type, and re-generate a query for content search using only the remaining speech elements. In the above-described example, the controller 320 may remove a speech element corresponding to at least one of a broadcast channel, an audience rating, and a broadcast type, and re-generate a query for content search using the remaining speech elements. That is, the controller 320 removes the speech element for the broadcast channel and generates a query for searching for content whose viewing rating is any age and the broadcast type is rebroadcast, or removes the speech element for the viewer rating and the broadcast channel is CH7 , and the broadcast type may generate a query for searching for rebroadcast content, or remove the speech element for the broadcast type and generate a query for searching for content with a broadcast channel of CH7 and an audience rating of all ages.

On the other hand, when a content search is not performed by a query generated by adding a preset item as a content search criterion, the controller 320 may regenerate a query for searching content by using the extracted speech element. That is, when there is no content that satisfies both the extracted utterance element and the search condition value added as the content search criterion, the controller 320 may re-generate a query for content search using only the extracted utterance element. .

In the above example, it is assumed that the channel currently watched by the user is No. In this case, the controller 320 may generate a query for searching for content whose broadcast channel is CH2 and the broadcast type is rebroadcast, and transmit the generated query to the external server 400 .

However, when the external server 400 has the structured metadata as shown in FIG. 5 , in that there is no content satisfying the query received from the second server 300 , the external server 400 does not display the search result. A non-existent response may be transmitted to the second server 300 . In this case, the controller 320 may re-generate a query for content search using only the extracted utterance elements. That is, in the above-described example, the controller 320 may generate a query for searching for content whose broadcast type is rebroadcast, and transmit the generated query to the external server 400 .

FIG. 6 is a block diagram illustrating a detailed configuration of the second server shown in FIG. 4 . Referring to FIG. 6 , the second server 300 may further include a storage unit 330 in addition to the components shown in FIG. 4 . Meanwhile, among the components illustrated in FIG. 6 , the components overlapping with those illustrated in FIG. 4 have the same functions, and thus detailed descriptions thereof will be omitted.

The storage unit 330 may store information on content classification criteria in each item. That is, the storage unit 330 may store each item of the structured metadata stored in the external server 400 and information on a content classification criterion for classifying each item. Accordingly, the control unit 320 may determine whether the content classification criterion in the item corresponding to the extracted utterance element is equal to or less than a preset number based on the information on the content classification criterion.

Also, the storage 330 may store various information for determining the user's intention to speak by using the text information received from the display apparatus 100 .

Specifically, the storage unit 330 uses the text information received from the display apparatus 100 to analyze a target domain, a target function, a main feature, and the like, from the user's voice. A variety of information can be stored.

Here, the target area may be divided according to a subject to which the user's voice belongs, such as "broadcasting" and "device control". In addition, the target function indicates the user's intention to speak, such as "information output" and "device control", and the main feature is object information about the target area, that is, information that can materialize the user's intention to speak in the target area. indicates.

Specifically, the storage 330 may store keywords for analyzing a target function in the target area and extracting main features.

For example, in the storage unit 330, keywords such as “recommend”, “search”, “find me”, and “show me” in the broadcast target area correspond to a target function corresponding to a request for information retrieval, and Various keywords related to content such as title, performer, producer, genre, broadcast type, broadcast time, picture quality, viewing rating, and broadcast channel may be stored, and information that each keyword corresponds to a main characteristic may be stored. As a specific example, the term “rebroadcast program” is a keyword related to a broadcast type, and information indicating that it corresponds to a main characteristic may be stored.

As another example, in the storage unit 330 , keywords such as “turn on”, “upper”, “lower”, “turn off”, “run”, etc. in the device control target area correspond to the request for device control of the target function. and various keywords related to device control, such as channel name, channel number, volume, power, etc., may be stored, and information that each keyword corresponds to a main characteristic may be stored.

As another example, in the storage unit 330, terms such as “yes” and “yes” in each target area are keywords having a positive meaning, and terms such as “no” and “dislike” are keywords having a negative meaning. information corresponding to the .

Also, the storage unit 330 may include a corpus database. Here, the corpus database may be implemented in the form of storing example sentences and answers thereto.

That is, the storage 330 may store a plurality of example sentences and answers to each example sentence for each target area. In this case, the storage unit 330 may tag and store the answer for interpreting the example sentence and corresponding to the example sentence for each example sentence.

For example, the storage unit 330 may store an example sentence "find a rebroadcast program" in the broadcast target area. In this case, the storage unit 330 may store information for interpreting an example sentence such as “find a rebroadcast program” by tagging the example sentence. Specifically, the storage unit 330 includes information that, in an example sentence such as “find a rebroadcast program”, “rebroadcast program” indicates a broadcast type as a main feature, and “find it” indicates a search request for content, in the example sentence You can tag and save.

As another example, the storage unit 330 may store an example sentence such as “play ○ times” in the device control target area. In this case, the storage unit 330 may store information for interpreting an example sentence such as “play ○ times” by tagging the example sentence. Specifically, the storage unit 330 tags and stores information indicating a power-off request in an example sentence such as “play ○ times” where “number ○” represents a channel number as a main feature and a power-off request in an example sentence such as “play ○ times”. can

Accordingly, the controller 320 may extract a utterance element from the text information received from the display apparatus 100 by using the information stored in the storage 330 , and determine the user's utterance intention by using the extracted utterance element.

For example, it is assumed that text information such as “find a rebroadcast program” is received from the display apparatus 100 . In this case, the controller 320 may extract “rebroadcast program” as an utterance element from “find a rebroadcast program” in that the term “rebroadcast program” is a major characteristic related to a broadcast type. In addition, the controller 320 may determine that "recommend me" corresponds to an information search request in the purpose function, and the utterance intention of "find a rebroadcast program" may determine that a search for a rebroadcast program is requested. In this case, the controller 320 may determine that the user's voice is inappropriate for the search, generate a query for content search by adding a search condition, and transmit it to the external server 400 . Also, the controller 320 may transmit response information for outputting a system response corresponding to “find a rebroadcast program” to the display device 100 from the display device 100 .

As another example, it is assumed that text information such as “play ○ times” is received from the display apparatus 100 . In this case, the control unit 320 may extract “○ times” as an utterance element from “play ○ times” in that the term “○ times” is a main characteristic related to a channel number. In addition, the controller 320 may determine that "play it" corresponds to a channel change request in the purpose function, and the utterance intention of "play ○ times" may determine that the channel change request is number ○. In this case, the controller 320 may transmit a control command for the display apparatus 100 to change the channel to number ○ to the display apparatus 100 .

7 is a diagram for explaining an example of a method of adding a content search criterion according to an embodiment of the present invention.

Meanwhile, since the method of adding the content search criteria has been described in detail with reference to FIGS. 4 to 6 , it will be schematically described in this drawing.

When text information corresponding to the user's voice is received (S710), the second server 300 extracts a utterance element from the user's voice (S720). Then, the second server 300 determines the validity of the search attribute of the extracted utterance element (S730). Specifically, the second server 300 may determine the validity of the search attribute of the extracted utterance element based on whether the content classification criterion in the item corresponding to the extracted utterance element is equal to or less than a preset number.

Accordingly, when it is determined that the extracted speech element is suitable as the search condition (S730-Y), the second server 300 generates a query for content search using the extracted speech element, and uses the generated query as an information source. That is, it can be transmitted to the external server 400 .

Meanwhile, if it is determined that the extracted utterance element is not suitable as a search condition (S730-N), it is possible to determine an item to be added as a content search criterion (S740). In this case, the second server 300 may generate a question for inquiring from the user whether to add the content search criteria ( S750 ), and provide the generated question to the user through the display apparatus 100 . Then, based on the answer to the question, a content search criterion is added to the extracted speech element, or a query for content search is generated only with the extracted speech element, and the generated query is used as an information source, that is, an external server 400 . can be transmitted

8 to 9 are diagrams illustrating an example of a UI screen provided by a display device according to an embodiment of the present invention.

For example, it is assumed that the user utters "find a rebroadcast program" as shown in FIG. 8(a).

In this case, the display apparatus 100 may display a UI screen 810 including a list of contents based on the response information received from the second server 300 as shown in FIG. 8(b) . In this case, the list of contents may be a list of contents searched by adding at least one of a broadcast time and a broadcast channel as a content search criterion.

Meanwhile, it is assumed that the user utters "find a rebroadcast program" as shown in FIG. 9( a ).

In this case, the display apparatus 100 may display a UI screen 910 for inquiring whether to add a content search criterion based on the response information received from the second server 300 as shown in FIG. 9(b). have. Accordingly, as shown in FIG. 9C , when the user utters “yes”, the display apparatus 100 displays a UI screen including a list of contents based on the response information received from the second server 300 . 920 may be displayed. In this case, the list of contents may be a list of contents searched by adding broadcast time as a content search criterion.

10 is a flowchart illustrating a method for controlling a server according to an embodiment of the present invention.

First, text information corresponding to the user's voice collected by the display apparatus is received from the display apparatus (S1010).

Thereafter, a utterance element is extracted from the text information, and a query for searching content is generated using the extracted utterance element (S1020).

Specifically, if the content classification criteria in the items corresponding to the extracted utterance elements are less than or equal to the preset number, the query is generated by adding the preset items as the content search criteria.

Here, the item for which the content classification criterion is less than or equal to a preset number may be at least one of a broadcast type item and a quality item. Also, the preset item may be at least one of a broadcast time item and a broadcast channel item.

To this end, it may be determined whether the number of content classification criteria in the item corresponding to the extracted utterance element is less than or equal to a preset number based on the pre-stored information on the content classification criterion.

Also, the preset item to be added as a content search criterion may be determined based on user preference information.

Meanwhile, when a content search is not performed by a query generated by adding a preset item as a content search criterion, a query for searching content may be regenerated using the extracted speech element.

Then, the generated query is transmitted to an external server that classifies and stores metadata for content by item (S1030).

In this regard, a method of generating a query in consideration of a preset item or user preference information has been described above with reference to FIGS. 1 to 9 .

In addition, a non-transitory computer readable medium in which a program for sequentially performing the control method according to the present invention is stored may be provided.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although a bus is not shown in the above block diagram of the display device and the server, communication between the respective components in the display device and the server may be made through the bus. In addition, each device may further include a processor such as a CPU or a microprocessor that performs the various steps described above.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

300: second server 310: communication unit
320: control unit

Claims (20)

In the display device,
display unit;
signal receiving unit;
voice receiver; and
receiving a user voice input through the voice receiving unit while outputting content based on the signal received through the signal receiving unit to the display unit;
When the information corresponding to the content is used for the result screen corresponding to the received user voice input, the display unit is controlled to output a first list based on the information corresponding to the user voice input and the content,
and a processor controlling the display unit to output a second list based on the user voice input when the information corresponding to the content is not used for the result screen corresponding to the received user voice input. According to claim 1,
The information corresponding to the content includes information on a content channel,
The processor is
When the information corresponding to the content is used for the result screen corresponding to the user voice input, the display device outputs the first list based on the information on the user voice input and the content channel. 3. The method of claim 2,
The first list is
A display device comprising a plurality of content programs provided from a content channel corresponding to the content. 4. The method of claim 3,
The first list is
A display device comprising a plurality of thumbnails corresponding to the plurality of content programs. According to claim 1,
The processor is
and outputting one of the first and second lists while overlapping the content. According to claim 1,
The content included in the first list is different from the content included in the second list. According to claim 1,
The processor is
When the information corresponding to the content is used for the result screen corresponding to the user's voice input, data corresponding to the first list based on the information corresponding to the user's voice input and the content transmitted to the server through the communication unit Receiving from the server, the display device. According to claim 1,
When the information corresponding to the content is used for the result screen corresponding to the user's voice input, when a plurality of content equal to or greater than a preset number are searched for when the content is searched based on the user's voice input. According to claim 1,
The processor is
When the information corresponding to the content is used for the result screen corresponding to the user's voice input, a UI inquiring whether to receive a result screen in consideration of the information corresponding to the content is output,
A display device configured to output one of a first list based on information corresponding to the user voice input and the content and a second list based on the user voice input based on a subsequent user voice input received while the UI is being output. . According to claim 1,
The information on the first and second lists is received from a server through one of a local area network (LAN), ethernet and Wi-Fi, a display device. A method for controlling a display device, comprising:
receiving a user voice input while outputting content; and
When the information corresponding to the content is used for the result screen corresponding to the received user voice input, a first list is output based on the information corresponding to the user voice input and the content,
and outputting a second list based on the user's voice input when the information corresponding to the content is not used for the result screen corresponding to the received user's voice input. 12. The method of claim 11,
The information corresponding to the content includes information on a content channel,
The step of outputting the first list comprises:
When the information corresponding to the content is used for the result screen corresponding to the user voice input, the control method of the display apparatus, outputting the first list based on the information on the user voice input and the content channel. 13. The method of claim 12,
The first list is
A method of controlling a display device, comprising a plurality of content programs provided from a content channel corresponding to the content. 14. The method of claim 13,
The first list is
A method of controlling a display device, comprising a plurality of thumbnails corresponding to the plurality of content programs. 12. The method of claim 11,
The step of outputting the first list comprises:
Including; outputting the first list overlapped with the content;
Outputting the second list comprises:
and outputting the second list overlapping the content. 12. The method of claim 11,
The content included in the first list is different from the content included in the second list. 12. The method of claim 11,
When the information corresponding to the content is used for the result screen corresponding to the user's voice input, data corresponding to the first list based on the information corresponding to the user's voice input and the content transmitted to the server is transmitted from the server. Receiving; further comprising, the control method of the display device. 12. The method of claim 11,
When the information corresponding to the content is used for the result screen corresponding to the user's voice input, when the content is searched based on the user's voice input, a plurality of content equal to or greater than a preset number is retrieved. Control of the display device Way. 12. The method of claim 11,
The step of outputting the first list comprises:
outputting a UI inquiring whether to receive a screen as a result of further consideration of information corresponding to the content; and
and outputting the first list based on information corresponding to the user voice input and the content based on a subsequent user voice input received while the UI is being output. 12. The method of claim 11,
The information on the first and second lists is received from a server through one of a local area network (LAN), ethernet and Wi-Fi, a control method of a display device.

Images