KR20170038772A - Display apparatus and method for controlling the display apparatus - Google Patents

Abstract

Disclosed is a display apparatus in which users are able to obtain a result optimized for intentions of the users. The display apparatus includes: an output unit; a voice collection unit for collecting a voice of a user; a first communication unit for transmitting the voice of the user to a first server, and receiving text information corresponding to the voice of the user from the first server; a second communication unit for transmitting the received text information to a second server; and a control unit for controlling the output unit to output a system response corresponding to speech intention of the user based on response information when the response information corresponding to the text information is received, wherein, when the speech intention of the user is related to at least one of performance of a function of the display apparatus and search for a content, the system response includes an additional question for performing the function corresponding to the speech intention of the user and for searching for the content.

Description

[0001] DISPLAY APPARATUS AND METHOD FOR CONTROLLING THE DISPLAY APPARATUS [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device and a control method thereof, and more particularly to a display device and a control method thereof that are controlled according to a user's voice.

Due to the development of electronic technology, various kinds of display devices have been developed and distributed, and gradually have various functions according to the needs of users. Especially, in the case of TV, recently, it is connected to the Internet to support Internet service, and users can view a large number of digital broadcasting channels through the TV.

Meanwhile, in recent years, technologies using speech recognition have been developed to control the display device more conveniently and intuitively. Particularly, in the case of TV, it is possible to recognize a voice of a user and to perform a function corresponding to the user's voice, such as volume control or channel change.

However, the conventional display devices for recognizing the user's voice provide a function corresponding to the recognized voice, and there is a limitation in providing interactive information through conversation with the user.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned needs, and it is an object of the present invention to provide an apparatus and method for performing a function corresponding to a user's utterance intention, And outputs a further question in a system response.

According to an aspect of the present invention, there is provided a display apparatus including an output unit, a voice collection unit for collecting a voice of a user, a voice server for transmitting the voice of the user to a first server, A first communication unit for receiving text information corresponding to a user's voice, a second communication unit for transmitting the received text information to a second server, and a second communication unit for, when the response information corresponding to the text information is received from the second server, And a control unit for controlling the output unit to output a system response corresponding to the user's utterance intention based on the response information, wherein the system response includes at least one of If it is related to one, a function for performing the function corresponding to the user's utterance intention, Including a question.

Here, the system response may include an additional question for confirming whether the function of the user is performed when the user's intention is related to performing the function of the display device.

In addition, the system response may include an additional question related to performing the preceding function when the user's utterance intention is related to performing a function of the display device and performing a preceding function before performing the function.

The system response may include an additional question expected according to the content search result when the user's utterance intention is related to the content search.

Wherein the system response may include additional questions related to at least one of a broadcast time search of the particular content and a search for similar content of the particular content when the content search is related to a broadcast time query of the particular content have.

In addition, the system response may include an additional question for inquiring another content search related to the person, when the content search is a person search related to the specific content.

According to another aspect of the present invention, there is provided a method of controlling a display device, the method comprising: collecting a user's voice; transmitting the voice of the user to a first server; Transmitting the received text information to a second server; and when the response information corresponding to the text information is received from the second server, responding to the user's utterance intention based on the response information Wherein the system response includes at least one of performing a function corresponding to the user's utterance intention if the utterance intention of the user is related to at least one of performing a function of the display device and retrieving a content, And may include additional questions for content retrieval.

Here, the system response may include an additional question for confirming whether the function of the user is performed when the user's intention is related to performing the function of the display device.

In addition, the system response may include an additional question related to performing the preceding function when the user's utterance intention is related to performing a function of the display device and performing a preceding function before performing the function.

The system response may include an additional question expected according to the content search result when the user's utterance intention is related to the content search.

Wherein the system response may include additional questions related to at least one of a broadcast time search of the particular content and a search for similar content of the particular content when the content search is related to a broadcast time query of the particular content have.

In addition, the system response may include an additional question for inquiring another content search related to the person, when the content search is a person search related to the specific content.

According to various embodiments of the present invention as described above, users can obtain a result optimized for their intention in that the user conducts continuous conversation with the display device through an additional question.

1 is a diagram for explaining an interactive system according to an embodiment of the present invention;
2 is a block diagram of a display device according to an embodiment of the present invention;
3 is a block diagram for explaining a detailed configuration of the display device shown in FIG. 2,
4 is a block diagram of the first server shown in FIG. 1;
FIG. 5 is a block diagram of the second server shown in FIG. 1;
Figures 6-9 illustrate examples of system responses output from a display device in accordance with various embodiments of the present invention,
10 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining an interactive system according to an embodiment of the present invention. 1, the interactive system 1000 includes a display device 100, a first server 200, and a second server 300. [

The display device 100 can be controlled by a remote controller (not shown) for controlling the display device 100. [ Specifically, the display apparatus 100 can perform a function corresponding to a remote control signal received from a remote controller (not shown). For example, when the display device 100 is implemented as a TV as shown in FIG. 1, the display device 100 can perform functions such as power on / off, channel switching, and volume change according to a received remote control signal have.

Also, the display device 100 can perform various operations corresponding to the user's voice.

Specifically, the display apparatus 100 may perform a function corresponding to the user's voice, or may output a system response corresponding to the user's voice.

To this end, the display apparatus 100 transmits the collected user's voice to the first server 200. When the user's voice is received from the display device 100, the first server 200 converts the received voice of the user into text information (i.e., text) and transmits the text information to the display device 100.

Then, the display apparatus 100 transmits the text information received from the first server 200 to the second server 300. When the text information is received from the display device 100, the second server 300 generates response information corresponding to the received text information and transmits the response information to the display device 100.

The display device 100 may perform various operations based on the response information received from the second server 300. [

Here, the response information includes a control command for the display device 100 to perform a specific function, a control command for outputting a system response in the display device 100, and a control command for outputting a system response to the system response outputted from the display device 100 And response information.

Specifically, the display device 100 can perform a function corresponding to the user's voice. That is, the display apparatus 100 can perform a function corresponding to the user's voice among the functions available in the display apparatus 100. For example, the display device 100 can switch the channel O times based on the control command received from the second server 300, when the user's voice " have. In this case, the second server 300 may transmit a control command for switching the channel of the display device 100 to the display device 100.

Further, the display apparatus 100 can output a system response corresponding to the user's voice. Here, the system response may be output in the form of at least one of a voice and a UI screen.

For example, when the user's voice inquiring about the broadcast time of the specific broadcast program is inputted, the display device 100 displays the broadcast time of the broadcast program on the basis of the system response information received from the second server 300, UI screen in the form of at least one. In this case, the second server 300 may transmit the system response information in which the system response outputted from the display device 100 is expressed in a text format to the display apparatus 100. [

Alternatively, the display apparatus 100 may output the broadcast time of the broadcast program in the form of at least one of a voice and a UI screen based on the control command received from the second server 300. In this case, the second server 300 may transmit a control command to the display device 100 to output the broadcast time of the broadcast program inquired by the user in the display device 100 in the system response.

In the case where the user's utterance intention is related to at least one of the performance of the display device 100 and the retrieval of the content, the display device 100 may perform a function corresponding to the user's utterance intention and an additional question Can be output in response. That is, the display device 100 may output an additional question in a system response to the user's voice, in order to execute a function intended by the user or to output a system response intended by the user.

For example, the display apparatus 100 assumes that the user's utterance intention is related to the performance of the display apparatus 100. [ In this case, the display apparatus 100 may check whether the function is performed, or may output an additional question related to the execution of the preceding function in the system response when the execution of the preceding function required to perform the function is required.

As another example, the display device 100 may output an additional question expected in accordance with a content search result in a system response when the user's utterance intention relates to the content search.

In addition, the display apparatus 100 may output various additional questions in a system response, and specific embodiments will be described later with reference to the accompanying drawings.

Accordingly, the users can obtain a result optimized for their intention in that the users continue the conversation with the display device 100 through the additional question.

1, the display device 100 is a TV, but this is merely an example. That is, the display device 100 can be implemented not only on a TV but also on various electronic devices such as a mobile phone such as a smart phone, a desktop PC, a notebook, navigation, and the like.

In FIG. 1, the first server 200 and the second server 300 are implemented as separate servers, but this is merely an example. In other words, it may be implemented as one interactive server including the first server 200 and the second server 300.

2 shows a block diagram of a display device according to an embodiment of the present invention. 2, the display apparatus 100 includes an output unit 110, a voice collecting unit 120, a first communication unit 130, a second communication unit 140, and a control unit 150. [

The output unit 110 outputs at least one of a voice and an image. Specifically, the output unit 110 may output a system response corresponding to the user's voice collected through the voice collection unit 120 in at least one form of a voice and graphic UI.

To this end, the output unit 110 may include a display unit (not shown) and an audio output unit (not shown).

Specifically, the display unit (not shown) may provide various images that can be provided through the display device 100. In particular, the display unit (not shown) may configure and display a UI response including a text, an image, an icon, and a GUI, corresponding to the user's voice. Meanwhile, the display unit (not shown) may be implemented as a liquid crystal display (LCD), an organic light emitting diode (OLED), or a plasma display panel (PDP).

The audio output unit (not shown) can output a system response corresponding to the user's voice in a voice form. The audio output unit (not shown) may be implemented as an output port such as a jack or a speaker.

Also, the output unit 110 can output various contents. Here, the contents may include broadcast contents, VOD contents, DVD contents, and the like. Specifically, the display unit (not shown) outputs an image constituting the content, and the audio output unit (not shown) outputs audio constituting the content.

The voice collecting unit 120 collects the voice of the user. For example, the voice collecting unit 120 may be implemented as a micro-computer for collecting user's voice, integrated into the display device 100, or integrated with the display device 100 and separated from the display device 100. In a separate form, the voice collecting unit 120 may be implemented in a form that the user can grasp by hand, or may be placed on a table or a table, and may be connected to the display device 100 through a wired or wireless network So that the collected user's voice can be transmitted to the display device 100.

Meanwhile, the voice collecting unit 120 may determine whether the collected voice is the voice of the user, and may filter the noise (e.g., air conditioner sound, cleaner sound, music sound, etc.) from the voice of the user.

For example, when a user's voice of an analog form is inputted, the voice collecting unit 120 samples it and converts it into a digital signal. Then, the sound collection unit 120 calculates the energy of the converted digital signal, and determines whether the energy of the digital signal is equal to or greater than a predetermined value.

When the energy of the digital signal is equal to or greater than a predetermined value, the sound collection unit 120 removes the noise component from the digital signal and transmits the noise component to the first communication unit 130. At this time, the noise component is sudden noise that may occur in a home environment, and may include air conditioner sound, cleaner sound, music sound, and the like. On the other hand, when the energy of the digital signal is less than a preset value, the voice collection unit 120 does not perform any process on the digital signal but waits for another input.

Accordingly, the entire audio processing process is not activated by the sound other than the user's voice, so that unnecessary power consumption can be prevented.

The first communication unit 130 performs communication with the first server 200 (FIG. 1). Specifically, the first communication unit 130 may transmit the user's voice to the first server 200, and may receive the text information corresponding to the user's voice from the first server 200.

The second communication unit 140 performs communication with the second server (300 of FIG. 1). Specifically, the second communication unit 140 may transmit the received text information to the second server 300, and may receive the response information corresponding to the text information from the second server 300.

For this, the first communication unit 130 and the second communication unit 140 can communicate with the first server 200 and the second server 300 using various communication methods.

For example, the first communication unit 130 and the second communication unit 140 may be connected to a local area network (LAN), a WAN, an Ethernet, a Bluetooth, a Zigbee, a USB (Universal Serial Bus) 1394, Wifi, or the like, to perform communication with the first server 200 and the second server 300. To this end, the first communication unit 130 and the second communication unit 140 may include a chip or an input port corresponding to each communication method. For example, when performing communication using a wired LAN, the first communication unit 130 and the second communication unit 140 may include a wired LAN card (not shown) and an input port (not shown).

Although the display apparatus 100 has been described as having the separate communication units 130 and 140 for communicating with the first server 200 and the second server 300 in the above embodiment, It is only an example. That is, the display device 100 can communicate with the first server 200 and the second server 300 through one communication module.

In the above-described embodiment, the first communication unit 130 and the second communication unit 140 communicate with the first server 200 and the second server 300, but this is merely an example . That is, the first communication unit 130 and the second communication unit 140 may be connected to a web server (not shown) to perform web browsing, or may be connected to a content provider server that provides a VOD service, You may.

The control unit 150 controls the overall operation of the display device 100. That is, the control unit 150 can control the operations of the output unit 110, the voice collecting unit 120, the first communication unit 130, and the second communication unit 140. The control unit 150 may include a ROM (Read Only Memory) and a RAM (Random Access Memory) for storing a module for controlling the CPU (central processing unit) and the display device 100, and data.

Specifically, the control unit 150 may control the first communication unit 130 to collect the user's voice through the voice collection unit 120 and to transmit the collected user's voice to the first server 300. When the text information corresponding to the user's voice is received from the first server 200, the control unit 150 controls the second communication unit 140 to transmit the received text information to the second server 300 have.

In addition, when the response information corresponding to the text information is received from the second server, the controller 150 may perform various operations based on the response information.

Specifically, the control unit 150 can perform a function corresponding to the user's utterance intention based on the response information.

Here, the response information may include a control command for controlling the function of the display apparatus 100. [ Specifically, the control command may include an instruction for executing a function corresponding to the voice of the user among the executable functions in the display apparatus 100. Accordingly, the control unit 150 can control each component of the display device 100 so that the function corresponding to the user's voice is executed, based on the control command received from the second server 300. [

For example, when the display device 100 implemented by a TV collects the user's voice "O (no) (channel number)", the second server 300 transmits the message " It is determined that the intention of the user requests channel change to the channel No. (channel number), and the control command for changing the channel change to the channel number (channel number) is transmitted to the display device 100 according to the determined ignition intention . Accordingly, the control unit 150 can change the channel number (channel number) based on the received control command and control to output the content provided through the changed channel.

However, it should be understood that the controller 150 may control each component of the display device 100 to perform various operations such as power on / off and volume control according to the collected user's voice.

Also, the control unit 150 can control to output a system response corresponding to the user's utterance intention based on the response information.

Here, the response information may include system response information for outputting a system response corresponding to the user's voice in the display device 100. [ In this case, the response information may further include a control command for outputting a system response corresponding to the user's voice in the display device 100. [

Specifically, the system response information may be that the system response output from the display device 100 to the user's voice is expressed in a text format.

Accordingly, the control unit 150 can control the output unit 110 to output the system response corresponding to the user's voice using the received system response information.

For example, the control unit 150 may configure the UI screen to include the text that constitutes the received system response information, and output the UI screen through a display unit (not shown). Also, the control unit 150 can convert the system response information in the text format into a voice by using a TTS (Text to Speech) engine and output it through an audio output unit (not shown). The TTS engine is a module for converting text to speech, and the controller 150 can convert system response information in a text format into speech using various TTS algorithms that have been disclosed.

For example, when the display device 100 implemented with a TV collects a user's voice, " When will the name of the broadcast program? &Quot;, the second server 300 transmits? (Name of the broadcast program) "is determined to inquire about the broadcast time for the name of the broadcast program, and based on the judged utterance intention," Time is "(broadcast time)" can be expressed in a text format and transmitted to the display device 100.

In this case, the control unit 150 converts the "broadcast time of the inquired XXX (broadcast program name)" represented in the text format into voice and outputs it through the audio output unit (not shown) The UI screen may be configured to include the text " The broadcast time of the inquired XXX (broadcast program name) is " (the broadcast time) ", and output through the display unit (not shown).

As described above, the control unit 150 can perform a function corresponding to the voice of the user, or can control to output a system response corresponding to the voice of the user.

On the other hand, in the case where the system response corresponding to the user's voice is output without performing any other function in the display apparatus 100, the user's voice is not to be executed in the display apparatus 100 May further include the case.

For example, it is assumed that the display apparatus 100 is implemented as a TV that does not support the video call function. In this case, the second server 300 can transmit a control command for performing a video call to the display device 100 when the display device 100 collects the user's voice called " Call XXX ". However, the control unit 150 can not recognize the control command received from the second server 300 because the function corresponding to the corresponding control command is not supported in the display apparatus 100. In this case, the control unit 150 may output a system response of "an unsupported function" in the form of at least one of a voice and a UI screen.

On the other hand, in the above-described embodiment, the second server 300 has been described as transmitting system response information in the form of text to the display apparatus 100 in order to output the system response in the display apparatus 100, .

That is, the second server 300 may transmit the voice data itself constituting the system response outputted from the display device 100 or a part of the voice data constituting the corresponding system response to the display device 100. Also, the second server 300 may transmit a control command to the display device 100 to output a system response using the stored data in the display device 100. [

Accordingly, the control unit 150 can control to output the system response in consideration of the type of the response information received from the second server 300. [

Specifically, when the voice data itself or a part of the voice data constituting the system response is received, the control unit 150 processes the corresponding data in a form that can be output from the output unit 110 to form at least one of a voice and a UI screen .

In addition, the control unit 150 searches for data matching the control command among the stored data in the display device 100 by using the control command for outputting the system response using the stored data in the display device 100, The data can be processed and output in the form of at least one of a voice or a UI screen. To this end, the display device 100 may be storing data related to providing a system response and associated with the UI screen.

For example, the display device 100 may be storing complete sentence data, such as "is an unsupported function ".

Alternatively, the display device 100 may store some data constituting the system response such as "the broadcast time of the inquired < program name > &gt; is &lt; In this case, information for completing the system response may be received from the second server 300. For example, after the controller 150 completes the system response using the broadcast program name or the channel number received from the second server 300, the controller 150 determines that the broadcast time of the inquired " OOO (broadcast program name) " (Broadcast time) "in the form of at least one of a voice and a UI screen.

Meanwhile, when the user's utterance intention relates to the performance of the display apparatus 100 and the retrieval of contents, the control unit 150 outputs a function query corresponding to the user's utterance intention and an additional question for content search in a system response . In this case as well, the control unit 150 can use the response information received from the second server 300.

A detailed description thereof will be given later with reference to FIG. 6 through FIG.

3 is a block diagram illustrating a detailed configuration of the display device shown in FIG. 3, the display device 100 includes a storage unit 160, a receiving unit 170, a signal processing unit 180, a remote control signal receiving unit 191, an input unit 193, (195). Each of these components can be controlled by the control unit 150. Meanwhile, among the components shown in FIG. 3, the components overlapping with the components shown in FIG. 2 have the same functions, and therefore, a detailed description thereof will be omitted.

The storage unit 160 is a storage medium that stores various programs necessary for operating the display device 100, and can be implemented as a memory, a hard disk drive (HDD), or the like. For example, the storage unit 160 may include a ROM for storing a program for performing an operation of the controller 150, a RAM for temporarily storing data according to an operation of the controller 150, and the like. And an EEROM (Electrically Erasable and Programmable ROM) for storing various reference data.

The receiving unit 170 receives various contents. Specifically, the receiving unit 170 can receive content from a broadcasting station that transmits a broadcasting program using a broadcasting network or a web server that transmits a content file using the Internet.

In the case of receiving content from a broadcasting station, the receiving unit 170 may be implemented in a form including a tuner (not shown), a demodulator (not shown), an equalizer (not shown), and the like. On the other hand, in the case of an embodiment that receives content from a source such as a web server, the receiving unit 170 may be implemented with a network interface card (not shown).

As described above, the receiving unit 170 may be implemented in various forms according to the embodiment.

The signal processing unit 180 performs signal processing on the content so that the content received through the receiving unit 170 or the interface unit 195 can be outputted through the output unit 110. [

Specifically, the signal processing unit 180 may perform operations such as decoding, scaling, and frame rate conversion on an image constituting the content, and convert the image into a form that can be output from the display unit 111. In addition, the signal processing unit 180 may perform signal processing such as decoding on the audio that constitutes the content, and convert the format into a form that can be output from the audio output unit 112.

The remote control signal receiving unit 191 receives a remote control signal input from an external remote controller. The control unit 150 can perform various functions based on the remote control signal input to the remote control signal receiving unit 191. [ For example, the control unit 150 can perform functions such as power on / off, channel change, and volume control according to the control signal input from the remote control signal receiving unit 191.

The input unit 193 receives various user commands. The control unit 150 can execute a function corresponding to the user command input from the input unit 193. [ For example, the control unit 150 can perform power on / off, channel change, volume control, and the like according to a user command input from the input unit 193. [

For this, the input unit 193 may be implemented as an input panel. The input panel may be a key pad or a touch screen having a touch pad or various function keys, numeric keys, special keys, and character keys.

The interface unit 195 performs communication with an external device (not shown). Here, the external device (not shown) may be implemented by various types of electronic devices, and may transmit the content to the display device 100.

For example, when the display device 100 is implemented as a TV, an external device (not shown) is connected to the display device 100 such as a set-top box, a sound device, a game device, a DVD player, The present invention may be embodied in various forms of electronic devices.

For example, the interface unit 195 can perform communication with an external device (not shown) according to various wired communication methods such as HDMI and USB, and wireless communication methods such as Bluetooth and Zigbee. To this end, the interface unit 195 may include a chip or an input port corresponding to each communication method. For example, when performing communication with an external device (not shown) according to the HDMI communication method, the interface unit 195 may include an HDMI port.

Meanwhile, the control unit 150 may store the user preference information in the storage unit 160. Here, the user preference information may include information on a broadcast program that the user frequently watches.

Specifically, the control unit 150 determines a broadcast program provided in the channel selected through the receiver 170 based on the EPG information whenever a power-on and channel change command is input, Information on at least one of the input time, the title of the determined broadcast program, the genre, the channel number providing the broadcast program, and the channel name may be stored in the storage unit 160.

The controller 150 may analyze the stored information and determine that the content viewed more than a preset number of times is a broadcast program frequently viewed by the user. The control unit 150 may control the second communication unit 140 to store information about a broadcast program that the user frequently watches in the storage unit 160 or to transmit the information to the second server 300. [

Although FIG. 3 illustrates various components that may be included in the display device 100, the display device 100 does not necessarily include all of the components, and is not limited thereto. That is, some of the components may be omitted or added according to the product type of the display device 100, or may be replaced with other components.

4 is a block diagram of the first server shown in FIG. As shown in FIG. 4, the first server 200 includes a communication unit 210 and a control unit 220.

The communication unit 210 performs communication with the display device 100. Specifically, the communication unit 210 receives the user's voice from the display device 100, and can transmit the text information corresponding to the user's voice to the display device 100. To this end, the communication unit 210 may include various communication modules.

The control unit 220 controls the overall operation of the first server 200. In particular, when the user's voice is received from the display device 100, the control unit 220 generates text information corresponding to the user's voice and controls the communication unit 210 to transmit the generated text information to the display device 100.

Specifically, the control unit 220 can generate text information corresponding to the user's voice using a STT (Speech to Text) engine. Here, the STT engine is a module for converting a speech signal into text, and can convert a speech signal into text using various STT algorithms that have been disclosed.

For example, the control unit 220 detects the start and end of the voice uttered by the user in the voice of the received user to determine the voice interval. Specifically, the controller 220 calculates the energy of the received voice signal, classifies the energy level of the voice signal according to the calculated energy, and can detect the voice section through dynamic programming. The control unit 220 detects phonemes as a minimum unit of speech based on the acoustic model within the detected speech interval to generate phoneme data, and adds HMM (Hidden Markov Model) probability model to the generated phoneme data To convert the user's voice into text.

5 is a block diagram of the second server shown in FIG. As shown in FIG. 5, the second server 300 includes a communication unit 310, a storage unit 320, and a control unit 330.

The communication unit 310 performs communication with the display device 100. Specifically, the communication unit 310 receives the text information from the display device 100 and transmits the response information corresponding to the text information to the display device 100. To this end, the communication unit 310 may include various communication modules.

The storage unit 320 stores various information for generating response information corresponding to the text information received from the display device 100. [

Specifically, the storage unit 320 stores a conversation pattern for each service domain. Here, the service domain is divided into "broadcast", "VOD", "device control", "application management", "information (weather, stock, news, etc.)" depending on the subject to which the voice uttered by the user belongs . However, this is only an example, and the service domain may be classified according to various topics in addition to the above-mentioned topics, and the above-mentioned subjects may be integrated with each other. For example, a broadcast service domain and a device control domain for broadcast content may constitute one domain.

More specifically, the storage unit 320 may include a corpus database for each service domain. Here, the corpus database can be implemented in the form of storing an example sentence and an answer thereto.

That is, the storage unit 320 may store a plurality of example sentences and an answer to each example sentence for each service domain. In addition, the storage unit 320 may tag and store information for analyzing a sample sentence and an answer corresponding to the sample sentence for each example sentence.

For example, it is assumed that an example sentence "○○○ (broadcast program name) is stored?" Is stored in the broadcast service domain.

In this case, the storage unit 320 may tag and store information for interpreting a sample sentence such as " XXX (broadcast program name)? "In the example sentence. Specifically, the storage unit 320 indicates a broadcast program in the example sentences such as "When is the broadcast program name?", And "When" , And information indicating that the type of the example sentence is a question can be tagged and stored in the example sentence. In addition, the storage unit 320 can tag and store information that a word related to the broadcast program is arranged in the front part of the example sentence having the format of " when? Here, the word related to the broadcast program may include a name of a broadcast program, a performer, a director, and the like.

In addition, the storage unit 320 can tag and store the answer to the question " When is? XXX (broadcast program name)? &Quot; Specifically, the storage unit 320 can store the tagged "broadcast time" in the "inquiry <broadcast program name>" as the answer to "When is the broadcast program name?" have.

As another example, it is assumed that an example sentence "Give me the number of times (channel number)" is stored in the device control service domain.

In this case, the storage unit 320 may tag and store information for interpreting the example sentence such as " turn on the number (channel number) "in the example sentence. More specifically, in an example such as "Turn on the channel number (O) ", the storage unit 320 indicates the channel number, the channel number indicates the channel selection command, Can tag and store information indicating that the type of the example sentence is the request sentence in the example sentence. In addition, the storage unit 320 can tag and store information that a word related to the broadcast program is arranged in the front part of the example sentence having the format of " play back " Here, the word related to the broadcast program may be a channel number, a channel name, a broadcast program name, a performer, a maker, and the like.

As another example, the storage unit 320 may store examples such as "yes", "yes", "no", "hate", etc. in each service domain. In this case, the storage unit 320 can tag and store information for interpreting the example sentence in each example sentence.

Specifically, the storage unit 320 may store information indicating the meaning of affirmation such as "yes", "yes", and the like, and information indicating the meaning of negative as an example sentence such as "no" or "dislike".

In addition, the storage unit 320 may tag and store a control command for controlling the display device 100 in each example text. In particular, the storage unit 320 may tag and store a control command for controlling the display device 100 in an example sentence corresponding to the user's voice for controlling the display device 100. [ For example, the storage unit 320 can tag and store a control command for changing the channel of the display device 100 to " o &quot; in an example sentence such as &quot; Turn o (channel number). " Here, the control command may be a system command in the form of a script.

On the other hand, answers to examples can include additional questions. In this case, the storage unit 320 may tag and store the meaning indicated by the additional question for each additional query, and may tag and store a control command for controlling the display device 100 in the additional query.

For example, it is assumed that an example sentence "initialization of setting" is stored in the device control domain.

In this case, the storage unit 320 may tag and store information for interpreting the illustrative sentence such as "setting initialization " in the illustrative sentence. Specifically, the storage unit 320 displays a setting state of the display device 100 in the example of "setting initialization ", and" initialization " Can store information indicating that the request is a statement in the example sentence.

In addition, the storage unit 320 may tag and store additional questions such as "Initialize all settings? &Quot; in an example such as" SETUP RESET ". The storage unit 320 stores information indicating whether or not to initialize all the setting states of the display device 100 by inquiring whether or not to initialize all the settings, And the control command for initializing the initialization command can be tagged and stored.

As another example, it is assumed that an example sentence of "raise the volume appropriately" is stored in the device control domain.

In this case, the storage unit 320 may tag and store information for interpreting the illustrative sentence such as " raise the volume appropriately " to the illustrative sentence. Specifically, the storage unit 320 indicates the volume of the display device 100, such as "moderate "," up " Volume ", and" look "can tag and store information indicating that the type of the example sentence is a request statement in the example sentence.

The storage unit 320 may tag and store a control command for increasing the volume of the display device 100 to a predetermined volume value (for example, 10) in an example sentence such as "raise the volume appropriately ".

In addition, the storage unit 320 can tag and store additional questions such as " Is the volume adjusted to 10 ?, "in an example such as" Then, the storage unit 320 can tag and store the meaning indicated by "Is the volume adjusted to 10? More specifically, the storage unit 320 may store a value indicating that the volume has been adjusted to 10, that is, whether or not it is acceptable to agree with the volume status of the display device 100 whose volume value has been increased to 10 .

In this way, the storage unit 320 may store the example sentences, the answers, and the additional questions. In this case, the storage unit 320 stores the information for interpreting the illustrative sentence and the meaning of the additional question in consideration of the meaning, attribute, etc. of each word constituting the illustrative sentence, the answer, and the additional question, Tagging can be saved.

In addition, the storage unit 320 may store various examples, answers, and additional questions thereto using the above-described method. In this case, the storage unit 320 may tag and store a control command for controlling the display device 100 in an additional question.

For example, the storage unit 320 may be referred to as "TV (terminate the display device 100) " within the device control domain. Information for interpreting the example sentences and additional questions such as "Turn off the power?" Can be tagged and stored in the example sentence. At this time, the storage unit 320 may store a control command for turning off the power of the display device 100 by storing the power off of the display device 100 as a meaning of turning off the power, .

As another example, the storage unit 320 stores an example sentence such as " TV (display apparatus 100 name) ", " Would you like to quit watching the TV? "Can be tagged and saved in the example. At this time, the meaning of "Do you want to end watching TV at? Time?" Is stored in the storage unit 320 as inquiring about power-off of the display device 100 at the time of? 100 may be stored.

As another example, the storage unit 320 should set an example sentence such as " Give an alarm at o "within the device control domain, information for interpreting the example sentence, and" Would you like to set it up? "Can be tagged and stored in the example. In this case, the storage unit 320 stores the inquiry about whether or not the time of the display device 100 is set by inquiring whether or not the time is set first and the current time should be set. And a control command for displaying a time setting menu of the time setting menu.

As another example, the storage unit 320 may store an example sentence such as " What time does the broadcast program name start at? (Date) ?, "in the broadcast service domain, have. In this case, the storage unit 320 arranges words associated with broadcast dates (for example, now, tomorrow, and the like) at the beginning of the example sentences having the format of " Alternatively, information that can be omitted can be tagged and stored in the example sentence.

In this case, the storage unit 320 can tag and store various additional questions about " What is the time at? 00? (Date)?

First, the storage unit 320 may tag and store additional questions such as " Do you want to set an alert? In this case, the storage unit 320 stores "Y" (broadcast time), "Do you want to set a notification?" To inquire whether or not to set a notification for "XXX" (broadcast program name) It is possible to store a control command for setting the notification of the display device 100 to &quot; o &quot;.

In this case, the storage unit 320 can tag and store another additional question such as "Do you need a scheduled recording?" In an additional question such as "Would you like to set up an announcement? have. In this case, the storage unit 320 stores the meaning of "Do you want to make a scheduled recording ?, " to inquire whether or not to set the reserved recording for the broadcast program name, And a control command for setting a reserved recording for O (broadcast program name).

Secondly, the storage unit 320 can tag and store additional questions such as " Would you like to find out what time it is? &Quot;? In this case, the storage unit 320 stores the meaning of " Do you want to know when? &Quot; Program name) It can be saved by querying whether or not to search broadcast time. In this case, the storage unit 320 may store the tagged "OOOO (broadcast program name) broadcast time is < broadcast time" as a response to the user's voice received after the further query.

Thirdly, the storage unit 320 can tag and store additional questions such as "Would not you like to search for other broadcast programs that can be broadcast today? XXX (broadcast program name)?" have. In this case, the storage unit 320 stores the meaning of " XXX (broadcast program name) is not broadcasted today. Would you like to look for another broadcast program that can be viewed? It is possible to inquire whether or not to search for the broadcast time of another broadcast program having the same genre. In this case, the storage unit 320 may tag and store the " broadcast program name &quot; is &quot; in the broadcast time "

Fourth, the storage unit 320 can tag and store additional questions such as "Have you already started? (Time) before changing the channel? &Quot; In this case, the storage unit 320 indicates that the channel has been changed to the channel provided with the name of " XXX (broadcast program name) " And the display device 100 may store a control command for changing the channel to a channel provided with the name of the broadcast program.

In this way, the storage unit 320 can tag and store a plurality of additional questions for one example sentence.

Meanwhile, as another example, the storage unit 320 may include an example sentence such as " How can I see the name of the broadcast program? ). "You can tag additional questions such as" Do you want to watch? " In this case, the storage unit 320 is a broadcast program that can be viewed from " O (age) ". The meaning indicated by? And the display device 100 may store a control command for changing the channel to a channel provided with the name of the broadcast program.

As another example, the storage unit 320 is an example sentence such as "Who is the supervisor of the broadcast program name?" In the broadcast domain, information for interpreting the illustrative sentence, and "OOO (supervising name)". Would you like to search for your supervised work? " In this case, the storage unit 320 can be stored as inquiring about whether or not to search for a broadcast program created by &quot; Name of supervisor &quot;, " Would you like to search for a supervised work? have. In addition, the storage unit 320 can tag and store "< &lt; program name &gt;" as a response to the voice of the user received after the further query.

As another example, the storage unit 320 may include an example sentence such as " Tell me when the broadcast program name starts "in the broadcast domain, information for interpreting the illustrative sentence, and" Do you want to change the channel? "Can be tagged and stored in the example. In this case, the storage unit 320 indicates that the channel is to be changed by the channel provided with the name of the channel (i.e., the channel name of the broadcast program). And the display device 100 may store a control command for changing the channel to a channel provided with a broadcast program name.

As another example, the storage unit 320 may store an example sentence such as " I enjoyed it at XXX (day of the week) ", information for interpreting the illustrative sentence and " ) Will be broadcasted on ○ (broadcast time). And "○○○ (broadcasting program name) are broadcasting now. Would you like to change the channel"?

In this case, the storage unit 320 is informed that "○○○ (broadcast program name) is broadcast at ○ time (broadcast time)." It is possible to store a control command for setting the notification of the display device 100 to the " Yes " In addition, the storage unit 320 is a channel to which a &quot; XXX (broadcast program name) is currently being broadcast &quot;. And may store a control command for changing the channel of the display device 100 to a channel provided with the name of the broadcast program.

As another example, the storage unit 320 may store an example sentence such as "? (Channel name) now? XX (genre) ?, " ) Can now tag and tag additional questions such as "Are you looking for a ○○ (genre)?" On the example sentence. In this case, the storage unit 320 broadcasts the name of the broadcast program at the time of "XX (channel name)." The meaning indicated by "XX (genre)?" The user can inquire about whether or not to search for the broadcasting program.

As another example, the storage unit 320 stores an example sentence such as "Show a recorded broadcast list " in the broadcast service domain, information for interpreting the illustrative sentence, and" recorded broadcast programs are as follows. ? "Can be tagged and stored in the corresponding example. In this case, the storage unit 320 refers to the message "Recorded broadcast program is as follows. How many times do you want to see?" And a control command for outputting the &lt; RTI ID = 0.0 &gt; O &lt; / RTI &gt;

As another example, the storage unit 320 may store an example sentence such as " XXX (broadcast program name) why is not so fun? &Quot; in the broadcast service domain, and information for interpreting the illustrative sentence " Would you like to change it? "Can be tagged and stored in the example. In this case, the meaning of "Do you want to change the channel?" Is stored in the storage unit 320 as inquiring about whether or not to change the channel, and the display device 100 displays the channel A control command for changing the control command can be stored.

As such, the storage unit 320 may store various examples, answers, and additional questions.

The control unit 330 controls the overall operation of the second server 300. In particular, when the text information corresponding to the user's voice is received from the display device 100, the control unit 330 generates response information corresponding to the received text information, and displays the generated response information through the communication unit 310 To the device (100).

Specifically, the control unit 330 analyzes the text information to determine a speech intention included in the user's voice, generates response information corresponding to the determined speech intention, and transmits the generated response information to the display unit 100 Can be controlled.

For this, the control unit 330 may detect a corpus database in which a dialog pattern matching the received text information exists, and determine a service domain to which the user's voice belongs.

Specifically, the controller 330 compares the received text information with example sentences stored for each service domain, and determines that the service domain to which the example text matching the received text information belongs is the service domain to which the user's voice belongs.

For example, when the control unit 320 receives a text message " Do Oooo (broadcasting program name) ?,? O? (Channel number) It can be determined that the user's voice collected by the display device 100 belongs to the broadcasting service domain. However, this is only an example. When text information matched to various examples stored in the storage unit 320 is received, it can be determined that the user's voice belongs to the service domain in which the mapped sample text exists.

On the other hand, when there is no example matched to the received text information, the controller 330 can statistically determine the domain to which the user's voice belongs.

For example, it is assumed that the display apparatus 100 collects "Please turn o (channel number)" and transmits the text of the collected user's voice to the second server 300. In this case, the control unit 330 uses the classification model such as HMM (Hidden Markov Model), CRF (Condition Random Fields), and SVM (Support Vector Machine) It is judged that they are statistically similar, and it can be judged that "oo (channel number) please" belongs to the broadcasting service domain. However, this is only an example, and the control unit 330 may determine whether the various examples stored in the storage unit 320 and the user's voice are statistically similar to determine the domain to which the user's voice belongs.

On the other hand, the control unit 330 extracts a dialogue act, a main action, and a component slot (or an entity name) from the user's voice based on the service domain to which the user's voice belongs.

Here, the paragraph is a classification criterion related to the form of a sentence, and indicates whether the sentence is a statement, a request, or a question.

Driving is semantic information that represents the desired behavior of the utterance through dialogue in a specific domain. For example, in the broadcast service domain, driving may include turning on / off the TV power, locating a broadcast program, locating a broadcast program time, reserving a broadcast program, and the like. As another example, in the device control domain, driving may include device power on / off, play, pause, and the like.

A component is information added to specify entity information for a specific domain appearing in an utterance, that is, a meaning of an action intended by a specific domain. For example, in a broadcast service domain, a component may include a genre, a broadcast program name, a broadcast time, a channel number, a channel name, a cast, a producer, etc. In a device control service domain, . &Lt; / RTI &gt;

The control unit 330 determines the utterance intention included in the voice of the user using the extracted speech, travel, and components, generates response information corresponding to the determined utterance intention, and transmits the response information to the display apparatus 100 have.

Here, the response information may include a control command for the display device 100 to perform a specific function. To this end, the control unit 330 controls the display device 100 to transmit the tagged control command to the example sentence determined to match the user's voice. Also, the control unit 330 may generate a control command corresponding to the determined ignition intention, and control the generated control command to be transmitted to the display device 100. [

On the other hand, the response information may include system response information for the system response output from the display device 100. For this, the control unit 330 extracts the answers to the determined utterance intention and the additional questions from the storage unit 320, and converts the extracted answers and the additional questions into text format and transmits them to the display apparatus 100. [ That is, the control unit 330 extracts the tagged answers and the additional questions in the example text matched with the user's voice, and converts the extracted answers and the additional questions into the text format and transmits them to the display device 100.

In this case, the control unit 330 may transmit a control command to the display device 100 to output a system response from the display device 100. [

Hereinafter, a more specific method by which the control unit 330 generates response information corresponding to the user's voice will be described as an example.

First, the control unit 330 extracts the speech, the running, and the components from the voice of the user using the example text matched with the voice of the user or the tagged information of the example sentence determined to be statistically similar to the voice of the user, The response information corresponding to the voice can be generated and transmitted to the display device 100.

For example, it is assumed that the text "XXX (broadcast program name) is received from the display device 100 ".

In this case, the control unit 330 determines that the received text belongs to the broadcasting service domain, and when the " ○○○ (broadcasting program name) is matched with the text received in the broadcasting service domain, Travel, and components from the user's voice using the received information, and generate response information therefrom.

That is to say, the example of " XXX (broadcast program name) " stored in the broadcasting service domain is information for interpreting the example sentence, " "Indicates a broadcast time inquiry, and" do? "Is tagged with information indicating that the type of the example sentence is a question.

Accordingly, the control unit 330 refers to these pieces of information and determines that the text "OO (program name) when received" from the display device 100 is a question, the running is a broadcast time inquiry, and the components are O (Broadcast program name). Accordingly, the control unit 330 can determine that the user's utterance intention inquires about the broadcast time for the room.

In addition, the control unit 330 searches the storage unit 320 for an answer tagged in the example of "When is the broadcast program name?" Stored in the broadcasting service domain, Lt; / RTI &gt;

That is, the control unit 330 determines whether the broadcasting time of the inquired &lt; program name &gt; is " broadcasting time &quot;, which is a response tagged to &quot; "As the answer corresponding to the user &apos; s voice.

In this case, the control unit 330 can complete the blank included in the searched answer to generate a complete sentence.

For example, in the response such as " the broadcast time of the inquired <program name &quot; is &quot; the broadcast time &quot;, the control unit 330 determines that blank <program name> Quot; can be written. Then, the control unit 330 searches the EPG information for the broadcast time of "XXX (broadcast program name) " and writes the searched broadcast time in another blank &lt; broadcast time ". Accordingly, the control unit 330 generates the response information by expressing the complete type of sentence "The broadcast time of the inquired XXX (broadcast program name) is Saturday &quot; And transmits the response information to the display device 100.

Accordingly, the display device 100 displays the message "The broadcast time of the inquired XXX (broadcast program name) is 7 o'clock on Saturday" based on the response information received from the second server 300 Can be output in at least one form.

As another example, it is assumed that the text "o (play channel number)" is received from the display device 100. [

In this case, the control unit 330 determines that the received text belongs to the broadcasting service domain, and transmits information tagged in "Turn o (channel number) to match " Travel, and components from the user's voice and generate response information therefrom.

In other words, the example sentence " Play channel number ", which is an example sentence stored in the broadcast service domain, is information for interpreting the illustrative sentence, " , And "give" is tagged with information indicating that the type of the illustrative sentence is the request statement. Accordingly, the control unit 330 refers to these pieces of information and transmits the text "o (number of channels) " received from the display device 100 as a request message, while running is a broadcast channel selection command, Channel number). Accordingly, the control unit 330 can determine that the user's utterance intention is to request the broadcast station selection for the number " 0 ".

In addition, the control unit 330 searches the storage unit 320 for a control command tagged in "Yes (change channel number)" stored in the broadcasting service domain and transmits the retrieved control command to the display device 100 . That is, the control unit 330 may transmit a control command for changing the channel of the display device 100 to the display device 100.

Accordingly, the display apparatus 100 can change the channel to the &quot; No &quot; based on the response information received from the second server 300. [

In the above example, the control unit 330 generates a control command for executing the function of the display device 100 based on the control command tagged in the illustrative sentence. However, this is merely an example.

That is, the control unit 330 may generate a control command based on the determined ignition intention, and may transmit the control command to the display device 100. For example, when it is determined that the user's utterance intention is to request a channel selection for channel number 0, the control unit 330 may generate a control command for changing the channel to channel number 0 and transmit the control command to the display device 100 .

Also, in the above-described example, the control unit 330 transmits system response information for outputting the system response in the display device 100, but this is merely an example.

That is, when the display unit 100 is storing data constituting the system response in the display unit 100, the control unit 330 may transmit a control command for outputting the data in the system response to the display device 100. In addition, when the display unit 100 stores a part of the data constituting the system response, the control unit 330 may transmit only the information for outputting the complete system response to the display apparatus 100. [

For example, when an answer such as " the broadcast time of the inquired < program name > &gt; is &lt; It is possible to control the display device 100 to transmit information on the name of the broadcast program and the broadcast time for which the user inquires in order to construct a complete type of sentence. In this case, the control unit 330 may transmit to the display device 100 a separate control command for outputting the answer previously stored in the display device 100. [

Accordingly, the display apparatus 100 writes the information received from the second server 300 in the pre-stored answer, and sends the system response in the form of "the broadcast time of the inquired XXX (broadcast program name) is Saturday & Can be output.

Meanwhile, in the above-described embodiment, the controller 330 has been described for extracting the speech, the traveling, and the components using the tagged information in the illustrative sentence, but this is merely an example. That is, the controller 330 extracts the speech and travel using MaxEnt (Maximum Entropy Classifier) from the user's voice, and extracts the components using the CRF (Conditional Random Field).

However, the present invention is not limited to these embodiments, and the control unit 330 may extract speech, travel, and components from the user's voice through various known methods.

Meanwhile, when generating the response information corresponding to the determined utterance intention, the control unit 330 may generate the response information by using the additional question corresponding to the voice of the user according to the determined utterance intention.

The controller 330 may generate response information corresponding to the received text information and transmit the response information to the display device 100 in consideration of the additional question when the text information of the user's voice is received in response to the additional question.

In this case, if the controller 330 can not determine the intention of the user included in the voice of the currently received user, the control unit 330 refers to the previously received voice of the user, It is possible to judge the intention of utterance. Specifically, when the control unit 330 can not determine the user's utterance intention included in the voice of the user currently received based on the service domain to which the voice of the user previously received belongs, It is possible to determine the user's utterance intention included in the voice of the currently received user.

Specifically, when the user's utterance intention is related to the performance of the display device 100, the control unit 330 generates an additional question for confirming whether the function is performed or not, And transmits the response information to the display device 100. [ In this case, the control unit 330 may determine the additional question tagged in the example sentence matched to the user's voice, generate response information for outputting the additional question, and transmit the response information to the display device 100.

For example, if it is determined that there is a risk that the function corresponding to the voice of the user is immediately executed such as " Stop TV, "or " Response information for outputting the additional question in response to the response information, and transmits the response information to the display device 100. [

Hereinafter, it is assumed that text information corresponding to "Stop watching TV", "Watch TV until 10 o'clock", and "Initialize setting" is received from the display device 100.

In this case, the control unit 330 determines whether or not the ignition intention for "TV stop watch" is the power off of the display device 100, using the example sentence stored in the storage unit 320 and information for interpreting the example sentence , It can be determined that the power of the display device 100 is requested to be turned off at 10 o'clock for the ignition intention for "watch TV until 10 o'clock ". The control unit 330 may determine that the initialization state of the display device 100 is requested by using the stored example sentences and information for interpreting the example sentences.

However, since there is a risk that the power of the display device 100 is turned off or the setting state of the display device 100 is initialized, the control unit 330 transmits a control command for performing the corresponding function to the display device 100, Response information for outputting an additional question may be generated and transmitted to the display device 100. [

More specifically, the control unit 330 requests an additional question tagged in the additional question tagged as "Turn off the power?", "Turn off the power?" And "Watch TV until 10 o'clock" Quot ;, " Initialize all settings? &Quot;, which is an additional question tagged in "Initialize settings ", can be expressed in text format and transmitted to the display device 100. Accordingly, the display apparatus 100 displays the message "Turn off the power? &Quot;," Do you want to stop watching the TV at 10:00? "According to the response information received from the second server 300, Or, "Are you sure you want to reset all settings?" Or "Are you sure you want to turn off power?", "Do you want to end watching TV at 10?" Alternatively, a UI screen including "Are you sure you want to initialize all settings?" Can be displayed.

Then, the control unit 330 may transmit a control command to the display apparatus 100 to control the function of the display apparatus 100 according to the user's voice received after the further inquiry. In this case, the control unit 330 determines the ignition intention of the voice of the user, which has been received, considering the meaning indicated by the additional question, transmits the control command tagged in the additional question to the display device 100, ) Can be controlled.

For example, the control unit 330 determines whether the "Turn off the power? When the text information such as "YES" is received, the ignition intention determines that the display apparatus 100 is to be powered off, and transmits a control command for turning off the display apparatus 100 to the display apparatus 100 Lt; / RTI &gt; Accordingly, the display apparatus 100 can turn off the power of the display apparatus 100 according to the response information received from the second server 300.

As another example, the control unit 330 may display a message "Do you want to end watching TV at 10? If text information such as "YES" is received, the control unit 10 determines that the power of the display device 100 is requested to be turned off at 10 o'clock, and turns off the power of the display device 100 at 10 o'clock May be transmitted to the display device 100. Accordingly, the display apparatus 100 can turn off the power at 10 o'clock in accordance with the response information received from the second server 300. [

 As another example, the control unit 330 may be configured to "Initialize all settings? If the text information such as "YES" is received thereafter, it is determined that the ignition intention requests initialization of all setting states of the display apparatus 100, and a control command for initializing all the setting states of the display apparatus 100 is displayed To the device (100). Accordingly, the display apparatus 100 can initialize all setting states according to the response information received from the second server 300. [

On the other hand, if it is determined that the user arbitrarily quantizes uncertain words such as "raise the volume appropriately ", the control unit 330 may generate response information for outputting an additional question in the system response and transmit the response information to the display apparatus 100.

Specifically, when text information corresponding to "look up properly in volume" is received from the display device 100, the control unit 330 uses the example sentence stored in the storage unit 320 and the information for interpreting the example sentence, The volume of the display device 100 is increased to a predetermined volume value (for example, 10) by determining the volume increase request up to a predetermined volume value (for example, 10) May be transmitted to the display device 100. Accordingly, the display apparatus 100 can increase the volume to a preset volume value (e.g., 10) according to the response information received from the second server 300. [

Then, the control unit 330 expresses in a text format an additional question for confirming whether or not to increase the volume to a predetermined volume value, that is, "Is the volume adjusted to 10?" To the display device 100 . Thereafter, when text information such as "YES" is received, the control unit 330 can determine that the utterance intention satisfies that the volume value is adjusted to 10.

On the other hand, when the user's utterance intention is related to performing the function of the display apparatus 100 and before performing the preceding function, the control unit 330 generates an additional question related to performing the preceding function, 100 may transmit the response information to the display device 100 for outputting an additional question.

For example, when the control unit 330 is required to perform a preceding function that requires setting the current time before setting the alarm function such as " Give an alarm at the time (time) " And transmits the generated response information to the display device 100. [

More specifically, when the text information corresponding to "Give alarm at o'clock (time)" is received from the display device 100, the control unit 330 reads the text data stored in the storage unit 320, Information can be used to determine that the display device 100 requests an alarm setting at time 0 (time) when the user intends to ignite the alarm at time 0.

In this case, the control unit 330 determines that the current time should be set in advance on the display device 100 before the alarm setting, and the additional question "First, the current time should be set. And can be transmitted to the display device 100 in a text format. Accordingly, the display apparatus 100 outputs the voice of "Set the current time first? Would you like to set the time?" According to the response information received from the second server 300, or " You need to set it. Can you set the time? "

Thereafter, when the text information such as "YES" is received, the control unit 330 determines that the intention of the display device 100 requests the time setting of the display device 100, Commands to the display device 100. [ Accordingly, the display apparatus 100 can display a menu screen for setting the time according to the response information received from the second server 300. [

On the other hand, when the user's utterance intention is related to the content search, the control unit 330 generates additional questions that are expected according to the content search result, and displays response information for outputting additional questions in the display device 100, (100).

For example, when text information corresponding to " What is the start of a broadcast program? (OOo)? "Is received from the display device 100, the control unit 330 reads the text data stored in the storage unit 320, It can be determined that the speech intention for "What time does the ooooo (broadcast program name) start?" Using the information for interpreting the example sentence requests the broadcast time search of the ooooo (broadcast program name). In this case, the control unit 330 refers to the EPG information, searches for the broadcast time of OOO (broadcast program name) as "o" (broadcast time), and starts at "o" (broadcast time). Quot; can be expressed in a text format and transmitted to the display device 100. [0050]

Accordingly, the display device 100 outputs voice as "Start at o'clock (broadcast time)? Do you want to set up a notification?" According to the response information received from the second server 300, Time "), can I display a UI screen containing" Do you want to set an alert? "

Thereafter, when the text information such as "YES" is received, the control unit 330 determines that the ignition intention requests the alarm setting of the display device 100 at the time of o'clock (broadcast time) A control command for setting an alarm of the display device 100 can be transmitted to the display device 100. [ Accordingly, the display apparatus 100 can set an alarm in the time of o'clock (broadcast time) according to the response information received from the second server 300. [

However, when the text information such as "NO" is received, the control unit 330 can determine that the ignition intention is to reject the alarm setting of the display device 100 at the time of opening (broadcasting time). In this case, the control unit 330 may transmit the response information to the display device 100 to output another additional question tagged in the additional question. For example, the control unit 330 displays another additional question tagged as "Start at ○ (broadcast time)? Do you want to set an alert?" 100). Accordingly, the display apparatus 100 outputs a voice message indicating "Do you need a scheduled recording? &Quot; according to the response information received from the second server 300, or displays a UI screen including" Can be output.

Thereafter, when text information such as "YES" is received, the control unit 330 determines that the ignition intention requests the reservation setting of the display device 100 at the time of opening (broadcast time) To the display device 100, a control command for setting the reserved recording for the &quot; x &quot; Accordingly, the display apparatus 100 can set the reserved recording for the oo (city) program (broadcast program name) that starts in the o'clock (broadcast time) according to the response information received from the second server 300. [

In this manner, when the user's utterance intention is a broadcast time inquiry of a specific broadcast program, the control unit 330 generates an additional question for notification setting and schedule recording when the specific broadcast program searched is one, Lt; / RTI &gt;

As another example, when the text information corresponding to "What time is it started today? XXX (broadcast program name)?" Is received from the display device 100, the control unit 330 reads the example sentences stored in the storage unit 320, Using the information for interpreting the example sentences, it can be determined that the intention to speak "What time is it started today? (Name of the broadcast program)?" have. In this case, the control unit 330 refers to the EPG information and can search whether or not the broadcast program name is broadcasted today.

As a result of the search, when the control unit 330 determines that the broadcast program name is not broadcasted today, the control unit 330 determines that the broadcast program name " The additional question can be expressed in a text format and transmitted to the display device 100. [ Accordingly, the display device 100 outputs a voice message "Would you like to know if it is not broadcasted today? XXX (broadcast program name)? &Quot; according to the response information received from the second server 300 , "Would you like to find out what time it is? &Quot;?

When the text information such as "YES" is received, the control unit 330 determines that the intention of the speech request requests the broadcast time search of the " XXX (broadcast program name) " ○ (broadcast program name) can be searched for the broadcast time. Then, the control unit 330 can express the " oooooo (broadcast program name) broadcast time is oo day oo " (broadcast time) "in text format and transmit it to the display device 100 using the searched broadcast time have. Accordingly, the display apparatus 100 outputs the voice of "XXX (broadcast program name) &quot; is broadcast on the day of the week (broadcast time)" according to the response information received from the second server 300 , And the broadcast time of "○○○ (broadcast program name) is ○ day of week ○ time (broadcast time)".

As a result of the search, if the control unit 330 determines that the broadcast program name is not broadcasted today, "XXX (broadcast program name) " is not broadcasted today. Quot; can be displayed in a text format and transmitted to the display device 100. [0050] FIG. Accordingly, the display apparatus 100 can not broadcast the " XXX (broadcast program name) today " based on the response information received from the second server 300. Would you like to look for other broadcast programs that can be viewed? Quot ;, or " Would you like to find another broadcast program that can be viewed? &Quot;.

When the text information such as "Yes" is received, the control unit 330 determines that the utterance intention is a search request for a broadcast program having the same genre as "Quot;, " DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA &Lt; / RTI &gt; Accordingly, the display apparatus 100 can output a voice "DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA The UI screen including "DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA

In this manner, when the content search is related to the broadcast time inquiry of the specific content, the control unit 330 generates an additional question related to at least one of the search of the broadcast time of the specific content and the search of the similar content of the specific content, ). That is, when the user's utterance intention refers to a specific date and includes a query of a specific broadcast program, the control unit 330 may be associated with at least one of a broadcast time search of a specific broadcast program and a search for a similar program of a specific broadcast program An additional question can be generated and transmitted to the display device 100.

In this case, the control unit 330 first generates an additional question related to the broadcast time search of the specific broadcast program, and when the text information having the negative meaning is received from the display device 100, And transmits it to the display device 100.

As another example, when the text information corresponding to " What is the start of the broadcast program name? (?) (? Name? Quot ;, it is determined that the user intends to search for the broadcast time of the broadcast program name, and the broadcast time of the broadcast program name can be searched with reference to the EPG information. If the search result shows that the broadcast program name is currently being broadcasted, the control unit 330 converts it into text format "already started before xxx (time) Lt; / RTI &gt;

Accordingly, the display apparatus 100 outputs a voice message "Have started already? X (hours) ago? Would you like to change the channel? &Quot; based on the response information received from the second server 300, (Hours) ago. "Do you want to change the channel?".

If the text information such as "Yes" is received, the controller 330 determines that the speech intention is a channel change request to the channel provided with the name of the broadcast program, To the display device 100, a control command for changing the channel to the provided channel. Accordingly, the display apparatus 100 can change the channel to the channel provided with the name of the broadcasting program (OOO) based on the response information received from the second server 300.

like this. The control unit 330 generates an additional question for inquiring the channel change to the channel providing the specific content when the content search is related to the broadcast time inquiry of the specific content and the specific content being searched for is broadcasted to the display device 100 Lt; / RTI &gt;

As another example, when text information corresponding to " How many years can I watch? (Name of broadcast program)? "Is received from the display device 100, the control unit 330 reads the text information stored in the storage unit 320, (The name of the broadcast program) can be viewed using the information for interpreting the example sentence, it is judged that the intention of the speech is requested to search the rating of the broadcast program name . In this case, the control unit 330 refers to the EPG information, searches for the rating level of the broadcast program name (XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX) And can be transmitted to the display device 100 in a text format.

Accordingly, the display device 100 can output a voice as a broadcast program that can be viewed from " O (age) " based on the response information received from the second server 300, or " Quot; is a broadcast program that can be viewed from above. &Quot;.

If the text information such as "Yes" is received, the controller 330 determines that the speech intention is a channel change request to the channel provided with the name of the broadcast program, To the display device 100, a control command for changing the channel to the provided channel. Accordingly, the display apparatus 100 can change the channel to the channel provided with the name of the broadcasting program (OOO) based on the response information received from the second server 300.

In this manner, when the content search is related to the viewing grade of the specific content, the controller 330 may generate an additional question for inquiring the channel change to the channel for providing the specific content, and may transmit the additional question to the display device 100. In particular, when the viewing rating of a specific content is a rating that can not be viewed by a minor, the controller 330 may generate an additional question for inquiring the channel change to a channel that provides the specific content, and may transmit the additional question to the display device 100.

As another example, when text information corresponding to "Who is the manager of the broadcast program name?" Is received from the display device 100, the control unit 330 interprets the example sentences stored in the storage unit 320 and the example sentences stored in the storage unit 320 It is determined that the intention of "Who is the supervisor of the broadcast program name?" By using the information for requesting supervisory search of the broadcast program name. In this case, the control unit 330 ) Refers to the EPG information and searches for the director of " OOO (broadcasting program name) " and "OOO (search supervisor name). Do you want to search supervised work? "Can be expressed in a text format and transmitted to the display device 100. Accordingly, the display device 100 can display the response information received from the second server 300 On the basis of "○○○ (name of supervisor searched). Would you like to search for supervised works? ", Or" ○○○ (supervisor name searched). You can output a UI screen that includes a search for a supervised work.

If the text information such as "YES" is received, the control unit 330 determines that the utterance intention is a search request for a broadcast program created by the name of XXX (supervisory name) The name of the director) can be searched. Then, the controller 330 can express the answer such as " DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA Accordingly, the display apparatus 100 can output the voice of "DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA ) &Quot;. &lt; / RTI &gt;

In this manner, when the content search is a person search related to a specific content, the control unit 330 can generate an additional question for inquiring another content search related to the person, and transmit the additional query to the display device 100. [ In this case, when one person is detected according to the intention of the speech, the control unit 330 may generate an additional question for inquiring about other contents related to the person and transmit the additional question to the display device 100.

As another example, when the text information corresponding to "Tell me when the broadcast program name starts" is received from the display device 100, the control unit 330 interprets the example sentences stored in the storage unit 320 and the example sentences stored in the storage unit 320 It is possible to judge that the intention of "Tell me when I am starting the broadcast program name" using the information for this purpose is the broadcast time search and notification request of the broadcast program name. Refers to EPG information to search for the broadcast time of OOO (program name), and when the searched broadcast time comes, "OOO (program name) starts. The display device 100 can display the additional question such as "Do you want to change the channel? &Quot; in a text format and transmit it to the display device 100. Accordingly, ○○○ (name of broadcasting program) starts. Do you want to change the channel? ", Or" XXX (program name) starts. Do you want to change the channel? ".

If the text information such as "Yes" is received, the control unit 330 determines that the speech intention is a channel change request to the channel providing the channel name (xxx) To the display device 100, a control command for changing the channel. Accordingly, the display apparatus 100 can change the channel to the channel providing the channel name (xxx) based on the response information received from the second server 300. [

As another example, when the display device 100 receives the text information corresponding to "I enjoyed it at XXX (day of the week) ", the control unit 330 reads the text data stored in the storage unit 320, It can be determined that the request is a broadcast time search request of a broadcast program that the user frequently watches at XXX (day of the week). On the other hand, information on a broadcast program frequently viewed by a user (e.g., a broadcast program name) is stored in the storage unit 320 or can be received from the display device 100. [

Accordingly, the control unit 330 refers to the EPG information, searches for the broadcast time of the broadcast program that the user frequently watches, and "○○○ (broadcast program name) is broadcasted at ○ (broadcast time). ? "Can be converted into a text format and transmitted to the display device 100. Fig. Accordingly, the display apparatus 100 displays "○○○ (broadcast program name) is broadcast in ○ (broadcast time)" based on the response information received from the second server 300. " , Or a UI screen including "Do you want to set up a notification?" (Broadcast program name) is broadcast in "○ (broadcast time)".

Thereafter, when the text information such as "YES" is received, the controller 330 determines that the utterance intention is a notification setting request for the name of the broadcast program, And transmits the control command for setting to the display device 100. [ Accordingly, the display apparatus 100 can set a notification of the broadcast program name based on the response information received from the second server 300.

Alternatively, the control unit 330 refers to the EPG information to search for the broadcast time of the broadcast program frequently viewed by the user, and further inquiries such as "XXX (broadcast program name) is currently being broadcast " Into the text format and transmit the converted text to the display device 100. Accordingly, the display apparatus 100 outputs the voice of "XXX (broadcast program name) is currently broadcasting. Would you like to change the channel?" Based on the response information received from the second server 300, You can output the UI screen including "XXX (broadcast program name) is broadcasting now. Would you like to change the channel?"

If the text information such as "Yes" is received, the control unit 330 determines that the speech intention is a channel change request to the channel providing the channel name (xxx) To the display device 100, a control command for changing the channel to a channel providing the channel. Accordingly, the display apparatus 100 can change the channel to the channel providing the channel name (xxx) based on the response information received from the second server 300. [

In this manner, when the content search is a content search that is frequently viewed by the user, the control unit 330 may generate an additional question for inquiring about the notification setting or the channel change, and may transmit the additional question to the display device 100. In this case, the control unit 330 generates an additional question for setting the notification when the broadcast time of the searched content arrives within a predetermined time in consideration of the current time, and generates an additional question to inquire about channel change when broadcasting can do.

As another example, when text information corresponding to " ooo (genre) in ooo (channel name) "is received from the display device 100, the control unit 330 reads the text data stored in the storage unit 320, Using the information for interpreting the illustrative sentence, the intention of uttering "◯◯ (channel name), now ◯◯ (genre)" is the same as that of the broadcast program in which the genre is ◯◯ (genre) It can be judged whether or not it is a search. In this case, the control unit 330 can determine whether a broadcast program having a genre of XX (genre) is currently broadcasted at XX (channel name) by referring to the EPG information.

As a result of the determination, if the broadcast program with the genre of XX (genre) is not broadcasted at XX currently (channel name), the control unit 330 searches for the program currently being broadcasted at XX Additional questions such as " Would you like to find? XX (genre)? "Can be expressed in text format and transmitted to the display device 100 have. Accordingly, the display apparatus 100 broadcasts the currently selected broadcast program name in the form of "XX (channel name) " based on the response information received from the second server 300. & ), Or "○○ (channel name) now broadcasts ○○○ (the name of the broadcast program searched). Do you want to search for ○○ (genre)?" UI screen can be output.

Then, when the text information such as "YES" is received, the control unit 330 determines that the utterance intention is a search request for a broadcast program with a genre of XX (genre) ) Can be searched for. Then, the control unit 330 can express "? DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA? Accordingly, the display apparatus 100 outputs the voice "DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA Quot; program name) ".

In this way, if the user's utterance intention specifies a specific situation, that is, a channel and a time zone, and the content is a search request for a specific content, but the content matching the utterance intention is not found, And transmits it to the display device 100.

As another example, when the text information corresponding to the "Show Recorded Broadcast List" is received from the display device 100, the control unit 330 uses the example sentence stored in the storage unit 320 and information for interpreting the example sentence It can be determined that the utterance intention of "show recorded broadcast list" requests to output a list of recorded broadcast programs. The control unit 330 receives a control command for outputting a list of broadcast programs recorded by the display apparatus 100 and an additional question such as "Recorded broadcast programs are as follows. And may be transmitted to the display device 100. [ Accordingly, the display apparatus 100 can output a voice message "Recorded broadcast program is as follows? How many times do you want to watch? &Quot; based on the response information received from the second server 300, The program is as follows: How many times do you want to see? ". Then, the display device 100 can output a list of recorded broadcast programs.

Thereafter, when the text information such as "third" is received, the control unit 330 transmits a control command for reproducing the third program listed in the list of broadcast programs in which the genre is recorded to the display apparatus 100 Lt; / RTI &gt; Accordingly, the display apparatus 100 can reproduce the third program listed in the list of the broadcast programs recorded based on the response information received from the second server 300.

As another example, when text information corresponding to " oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo! Can be determined to be a channel change to another broadcast program by using the information for interpreting " XXX (name of the broadcast program) Why is this not so fun? &Quot;. In this case, the control unit 330 can convert the additional questions such as "Do you want to change the channel because it is still in the beginning ?," to a text format and transmit it to the display device 100. [ Accordingly, based on the response information received from the second server 300, the display apparatus 100 outputs a voice message "Do you want to change the channel because it is still in the beginning?" Or " Do you want? ".

Thereafter, when the text information corresponding to " Change to O (channel number) "is received, the control unit 330 determines that the speech intention is the channel change of the channel number (O) To the display device 100, a control command for changing the channel. Accordingly, the display apparatus 100 can change the channel by the number (channel number) based on the response information received from the second server 300. [

In this way, when the user clearly recognizes the broadcasting program that the user is currently viewing, the control unit 330 can generate an additional question for inquiring whether or not the other broadcasting program is viewed, and transmit the generated additional question to the display device 100. In this case, if a predetermined amount (e.g. 1/3 of the total amount) of the running time of the broadcast program currently watched by the user is not broadcasted, the control unit 330 generates the additional question as described above and displays it on the display device 100 ).

In this way, the second server 300 generates an additional question according to the user's intention to transmit to the display device 100, and the display device 100 transmits the additional question received from the second server 300 to the system response As shown in FIG. The second server 300 analyzes the speech intention included in the voice of the user for the additional question, performs the function corresponding to the utterance intention, or performs the function corresponding to the utterance intention Can be controlled.

Meanwhile, in the above-described example, the second server 300 expresses the answer to the user's voice and the additional question in text form and transmits it to the display device 100, but this is merely an example. The second server 300 may transmit information about the user's voice and additional questions to the display apparatus 100 in various forms in which the system response can be output from the display apparatus 100. [

Hereinafter, various embodiments of the present invention will be described with reference to FIGS. 6 to 9. FIG. 6 to 9 are diagrams for explaining various examples of outputting an additional question in the system response according to the user's utterance intention in the display device 100. [

First, the system response may include an additional question for confirming whether the function of the display device 100 is performed when the user's utterance intention relates to the function of the display device 100. [

For example, as shown in FIG. 6A, it is assumed that the user has uttered "setup initialization". In this case, based on the response information received from the second server 300, the control unit 150 outputs a UI screen 610 including a text "Do you want to initialize all settings? &Quot; can do.

6C, the controller 150 may initialize all the setting states of the display device 100 based on the response information received from the second server 300. [0064] FIG. Here, the setting may include all settings that can be set in the display device 100, such as a preferred channel, a screen setting, and the like.

Although FIG. 6 illustrates a case in which the user has uttered "set initialization", this is merely an example. That is, when the user's utterance intention is related to the function of the display apparatus 100, such as "stop watching TV" or "watch TV until 10 o'clock &quot;, the control unit 150 stores the response information received from the second server 300 Based on the system response, additional questions can be output to confirm whether the function is performed.

In addition, the system response may include additional questions related to the performance of the preceding function when the user's utterance intention is related to performing the function of the display device and the performance of the preceding function is required before the function is performed. That is, when the user's utterance intention is related to the performance of the display device such as "Give alarm at 7 o'clock &quot;, and the controller 150 needs to perform the preceding function before performing the function, Can be output in response.

Based on the response information received again from the second server 300, the control unit 150 determines whether or not an additional question such as "Stop watching TV", "Watch TV until 10 o'clock", "Give an alarm at 7 o'clock" It is possible to perform a function corresponding to the user's voice. This is described in detail with reference to FIG. 5, and a duplicate description will be omitted.

In addition, the system response may include additional questions that are expected based on the content search results, if the user's utterance intent is related to the content search.

Specifically, the system response may include additional questions related to at least one of a broadcast time search of a particular content and a search for similar content of a particular content when it is associated with a broadcast time query of a particular content.

For example, as shown in FIG. 7A, it is assumed that the user has uttered "What time is it today?". In this case, based on the response information received from the second server 300, the control unit 150 does not broadcast " XXX (broadcast program name) today " The UI screen 710 including the text &quot; Text &quot;

7C, when the user speaks "YES", the control unit 150 determines that "XXX (broadcast program name)" is "YES" on the basis of the response information received from the second server 300 The UI screen 720 including the text &quot; oday is o "can be output as a system response.

As another example, it is assumed that the user has uttered "What time is it today (○○○ (broadcast program name)?") As shown in Figure 8a. In this case, the control unit 150 does not broadcast the " XXX (broadcast program name) today " based on the response information received from the second server 300 as shown in FIG. 8B. Can display the UI screen 810 including the text &quot; Do you want to see? &Quot; in the system response.

Then, as shown in FIG. 8C, when the user speaks "Yes", the control unit 150 displays "? ΔΔ (broadcast program name)" on the basis of the response information received from the second server 300 UI screen 820 including the text &quot; DELTA DELTA DELTA &quot; is displayed in the system response.

In addition, the system response may include additional questions to query other content searches related to the person, if the content search is a person search related to the particular content.

For example, as shown in FIG. 9A, it is assumed that the user has uttered "Who is the supervisor of the broadcast program name?". In this case, based on the response information received from the second server 300, the control unit 150 includes the text "Yes (search supervisor name)? Would you like to search for the supervised work? The UI screen 910 can be output as a system response.

9C, when the user speaks "YES", the control unit 150 displays "? DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA DELTA Quot; is displayed in the system response.

In Figs. 7 to 9, it is assumed that the user selects "What is the name of the broadcast program today? Or "Who is the director of" ○○○ (name of broadcasting program)? ", But this is merely an example. In other words, the control unit 150 determines whether or not the user wants to listen to the message "Did I enjoy it at XXX (day of the week)" or "XXX (genre) at XX? If the user's utterance intention is related to the content retrieval, the second server 300 may output an additional question for confirming whether the function is performed based on the response information received from the second server 300 in the system response. Based on the response information received from the second server 300 again, the control unit 150 can perform a function corresponding to the voice of the user for each additional question. This is described in detail with reference to FIG. 5, and a duplicate description will be omitted.

10 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

First, the user's voice is collected (S1010).

Thereafter, the user's voice is transmitted to the first server, and text information corresponding to the user's voice is received from the first server (S1020).

Then, the received text information is transmitted to the second server (S1030).

When the response information corresponding to the text information is received from the second server, a system response corresponding to the user's utterance intention is output based on the response information (S1040). In this case, the system response includes an additional question for function execution and content search corresponding to the user's utterance intention, if the user's utterance intention relates to at least one of the performance of the display device and the content retrieval.

Specifically, the system response may include an additional question for confirming whether or not the function is performed when the user's utterance intention relates to performing the function of the display device.

In addition, the system response may include additional questions related to performing the preceding function when the user's utterance intention is related to performing the function of the display device and performing the preceding function before performing the function.

And, the system response may include additional questions expected according to the content search result, if the user's utterance intention relates to the content search. Specifically, the system response may include additional questions related to at least one of a broadcast time search of a particular content and a search for similar content of a particular content when the content search is related to a broadcast time query of the particular content. In addition, the system response may include additional questions to inquire about other content searches related to the person, if the content search is a person search related to the specific content.

A detailed description of a method for outputting a further question on the display device and a specific example of a further question have been described above.

Meanwhile, a non-transitory computer readable medium having a program for sequentially performing the control method according to the present invention may be provided.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

In addition, although a bus is not shown in the above-described block diagrams for the display device and the server, the communication between the respective components in the display device and the server may be performed through a bus. Further, each device may further include a processor such as a CPU, a microprocessor, or the like that performs the various steps described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: Display device 110: Output part
120: voice collecting unit 130: first communication unit
140: second communication unit 150:

Claims (12)

In the display device,
An output section;
A voice collecting unit for collecting voice of the user;
A communication unit for transmitting the voice of the user to a first server, receiving text information corresponding to the user's voice from the first server, and transmitting the received text information to a second server; And
And a control unit for controlling the output unit to output a system response corresponding to the user's utterance intention based on the response information when response information corresponding to the text information is received from the second server,
Wherein,
Wherein the first function of the display device corresponding to the user's utterance intention is performed when the user's utterance intention is related to performing a first function of the display device, And outputs the inquiry about whether or not the second function is performed to the system response. The method according to claim 1,
The system response includes:
Wherein the display control unit includes a question for confirming whether or not the first function is performed. The method according to claim 1,
The system response includes:
And an additional question related to performing the preceding function when the user's utterance intention is related to performing a first function of the display device and performing a preceding function before performing the first function. The method according to claim 1,
The system response includes:
And an additional question expected according to the content search result when the user's utterance intention is related to the content search. 5. The method of claim 4,
The system response includes:
And an additional question related to at least one of a broadcast time search of the specific content and a search for a similar content of the specific content when the content search is related to a broadcast time inquiry of the specific content. 5. The method of claim 4,
The system response includes:
And an additional question for inquiring another content search related to the person when the content search is a person search related to the specific content. A method of controlling a display device,
Collecting the user's voice;
Transmitting the voice of the user to a first server and receiving text information corresponding to the voice of the user from the first server;
Transmitting the received text information to a second server; And
And outputting a system response corresponding to the user's utterance intention based on the response information when the response information corresponding to the text information is received from the second server,
Wherein the outputting step comprises:
Performing a first function corresponding to the user's utterance intention when the user's utterance intention is related to performing a first function of the display device and performing a second function corresponding to the utterance intention of the user, And a step of outputting, in the system response, a question about whether or not to perform the second function. 8. The method of claim 7,
The system response includes:
Wherein the second function includes a question for confirming whether the first function is performed. 8. The method of claim 7,
The system response includes:
Further comprising an additional question related to performing the preceding function when the user's utterance intention is related to performing a first function of the display device and performing a preceding function before performing the first function. 8. The method of claim 7,
The system response includes:
And an additional question expected according to the content search result when the user's utterance intention relates to the content search. 11. The method of claim 10,
The system response includes:
Further comprising an additional question related to at least one of a broadcast time search of the specific content and a search for similar content of the specific content when the content search is related to a broadcast time inquiry of the specific content. 11. The method of claim 10,
The system response includes:
Further comprising an additional inquiry for inquiring another content search related to the person when the content search is a person search related to the specific content.

Images