KR20200141839A - A display device - Google Patents

Abstract

The present invention relates to a display device for providing a result desired by a user when receiving a voice command. The display device may comprise: a storage unit storing a keyword for executing a designated function; a voice acquisition unit receiving a voice command; a control unit acquiring information on the voice command and information on a designated function corresponding to a keyword if the keyword is included in the voice command; and a display unit displaying at least one of the information on the voice command and the information on the designated function.

Description

Display device {A display device}

The present invention relates to a display device, and more particularly, to a display device that provides a result suitable for a user's intention upon receiving a voice command.

With the development of natural language processing (NLP) technology, electronic devices such as TVs and speakers are able to provide a function of performing an operation according to a voice command when receiving a voice command from a user. That is, the recognition accuracy of voice commands is improving, and accordingly, users who give commands to electronic devices by voice are increasing. An example of prior art for an electronic device that receives a voice command is described in Korean Patent Application Laid-Open No. 10-2016-0029450.

Meanwhile, the display device may provide a function of setting a keyword so that a user can more conveniently access a function frequently used. For example, the display device may set a specific function to be executed when a specific keyword is received.

However, the user may utter a specific keyword to execute a preset specific function, but may utter a specific keyword to search for information on the specific keyword itself. In this case, there is a problem in that the display device cannot provide desired information because it is difficult for the user to know the intention of uttering a specific keyword.

An object of the present invention is to provide a display device that provides information desired by a user upon receiving a voice command.

An object of the present invention is to provide a display device in which a function of analyzing a user's intention for a voice command is enhanced upon receiving a voice command.

An object of the present invention is to provide a display device that provides a user-customized result upon receiving a voice command.

The display device according to an embodiment of the present invention corresponds to a storage unit storing a keyword for executing a specified function, a voice acquiring unit receiving a voice command, and when a keyword is included in the voice command, information on the voice command and the keyword The controller may include a control unit that obtains information on a designated function to be designated, and a display unit that displays at least one of information on a voice command and information on the designated function.

The display unit may simultaneously display information on a voice command and information on a designation function.

The control unit may further receive a priority setting command for any one of information on a voice command or information on a designated function.

When a priority is set for information on a voice command or information on a designated function, the controller may control the display to display only information corresponding to the priority.

When only the information corresponding to the priority is displayed, the controller may control the display to further display an icon for switching to information corresponding to the lower priority.

When receiving a command for selecting an icon for switching to information corresponding to the lower priority, the controller may control the display to display information corresponding to the lower priority instead of information corresponding to the priority.

When a priority is set for information on a voice command or information on a designation function, the controller may control the display to display information corresponding to the priority higher than information corresponding to the lower priority.

When a keyword is included in the voice command, the control unit may determine whether the voice command is a voice command that needs to provide a result for the keyword.

The control unit can display at least one of information on the voice command and information on the designated function if it is a voice command that needs to provide results for a keyword, and can display information on the voice command if it is not a voice command that needs to provide a result for the keyword. have.

The control unit receives a command for designating a user setting function to at least one keyword, maps the keyword and the specified function, and stores it in the storage unit, and the keyword may include at least one of numbers, words, and sentences.

According to an embodiment of the present invention, when a voice command is received, a user's intended result can be more accurately provided by providing a result according to the voice command in consideration of a designation function set as a keyword.

In addition, by displaying both information on the voice command itself and information on the specified function corresponding to the keyword included in the voice command when receiving a voice command, it is possible to minimize the case in which the user fails to provide the intended result. Accordingly, there is an advantage that reliability is improved.

In addition, when priorities are set, there is an advantage in that information preferred by the user can be more clearly displayed by differently controlling the order and size of results provided according to the priorities.

According to an embodiment of the present invention, there is an advantage of improving reliability by minimizing cases in which the user fails to provide an intended result through speech upon receiving a voice command.

1 is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.
2 is a block diagram of a remote control device according to an embodiment of the present invention.
3 shows an example of an actual configuration of a remote control device according to an embodiment of the present invention.
4 shows an example of using a remote control device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of operating a display device according to an embodiment of the present invention.
6 is an exemplary diagram illustrating a method of presetting a keyword for executing a specific function by a display device according to an exemplary embodiment of the present invention.
7 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information on a voice command.
8 is an exemplary diagram illustrating a case in which a display device according to an embodiment of the present invention simultaneously displays information on a voice command and information on a designation function.
9 is a flowchart illustrating a method of sequentially displaying information on a voice command and information on a designation function corresponding to a keyword by a display device according to an embodiment of the present invention.
10 is an exemplary diagram illustrating a method of setting a priority for information on a voice command or information on a designation function by a display device according to an embodiment of the present invention.
11 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information corresponding to a priority.
12 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information corresponding to subordinate rankings.
13 is a flowchart illustrating a method of displaying information on a voice command and information on a designation function corresponding to a keyword in different sizes by the display device according to an embodiment of the present invention.
14 is an exemplary diagram illustrating a case in which the display device according to an embodiment of the present invention displays information on a voice command and information on a designation function corresponding to a keyword in different sizes.
15 is a diagram illustrating a modified example of a method of displaying at least one of information on a voice command and information on a designation function by a display device according to an embodiment of the present invention.
16 is a flowchart illustrating a method of operating a display device according to another exemplary embodiment of the present invention.
17 is an exemplary diagram of a method of setting a specific channel number as a shortcut key by the display device according to an embodiment of the present invention.
18 is an exemplary diagram illustrating a method of displaying channel information according to a ternary input of a channel number by a display device according to an embodiment of the present invention.
FIG. 19 is a first exemplary diagram of a method of displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.
FIG. 20 is a second exemplary diagram of a method of displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.
FIG. 21 is a third exemplary diagram of a method for displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

1 is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display device 100 includes a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , A voice acquisition unit 175, a display unit 180, an audio output unit 185, and a power supply unit 190 may be included.

The broadcast reception unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

The tuner 131 may select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a selected specific broadcast channel.

The demodulator 132 may divide the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and restore the separated video signal, audio signal, and data signal into a form capable of outputting.

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

The network interface unit 133 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received.

In addition, the network interface unit 133 may receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 may receive content such as movies, advertisements, games, VODs, broadcast signals, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 may receive update information and an update file of firmware provided by a network operator, and transmit data to the Internet or content provider or network operator.

The network interface unit 133 may select and receive a desired application from among applications open to the public through a network.

The external device interface unit 135 may receive an application or an application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and the external device. The external device interface unit 135 may receive one or more of an image and audio output from an external device connected to the display device 100 by wire or wirelessly, and transmit it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

An image signal of an external device input through the external device interface unit 135 may be output through the display unit 180. The audio signal of the external device input through the external device interface unit 135 may be output through the audio output unit 185.

The external device connectable to the external device interface unit 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example. .

In addition, some content data stored in the display apparatus 100 may be transmitted to another user registered in advance in the display apparatus 100 or a selected user or a selected electronic device among other electronic devices.

The storage unit 140 may store a program for processing and controlling each signal in the control unit 170 and may store signal-processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 135 or the network interface unit 133. You can also store information about the image.

The storage unit 140 may store an application or an application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 may reproduce and provide a content file (movie file, still image file, music file, document file, application file, etc.) stored in the storage unit 140 to a user.

The user input interface unit 150 may transmit a signal input by the user to the controller 170 or may transmit a signal from the controller 170 to the user. For example, the user input interface unit 150 may be configured according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee method, Radio Frequency (RF) communication method, or infrared (IR) communication method, Control signals such as power on/off, channel selection, and screen setting may be received and processed from the remote control device 200, or a control signal from the control unit 170 may be transmitted to the remote control device 200.

In addition, the user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 170.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the corresponding image signal. Also, the image signal processed by the controller 170 may be input to an external output device through the external device interface unit 135.

The audio signal processed by the controller 170 may be audio output to the audio output unit 185. In addition, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the controller 170 may control the overall operation of the display apparatus 100.

In addition, the control unit 170 may control the display device 100 by a user command or an internal program input through the user input interface unit 150, and access the network to display an application or application list desired by the user. It can be downloaded within (100).

The control unit 170 enables channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

In addition, the control unit 170, in accordance with an external device image playback command received through the user input interface unit 150, from an external device input through the external device interface unit 135, for example, a camera or a camcorder, An image signal or an audio signal may be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 may control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131 or an external input input through the external device interface unit 135 An image, an image input through the network interface unit, or an image stored in the storage unit 140 may be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the control unit 170 may control content stored in the display device 100, received broadcast content, or external input content input from the outside to be played, and the content includes a broadcast image, an external input image, an audio file, and a stop. It may be in various forms such as an image, a connected web screen, and a document file.

The wireless communication unit 173 may communicate with an external device through wired or wireless communication. The wireless communication unit 173 may perform short range communication with an external device. To this end, the wireless communication unit 173 includes Bluetooth™, Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The wireless communication unit 173 may be configured between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks in which the display device 100 or an external server is located may be supported. The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

Here, the other display device 100 is a wearable device capable of exchanging (or interlocking with) data with the display device 100 according to the present invention, for example, a smartwatch, smart glasses. (smart glass), HMD (head mounted display)), it can be a mobile terminal such as a smart phone. The wireless communication unit 173 may detect (or recognize) a wearable device capable of communicating around the display apparatus 100. Further, when the sensed wearable device is an authenticated device to communicate with the display apparatus 100 according to the present invention, the controller 170 transmits at least a portion of the data processed by the display apparatus 100 to the wireless communication unit ( 173) can be transmitted to the wearable device. Accordingly, a user of the wearable device may use data processed by the display apparatus 100 through the wearable device.

The voice acquisition unit 175 may acquire audio. The voice acquisition unit 175 may include at least one microphone (not shown), and may acquire audio around the display apparatus 100 through a microphone (not shown).

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170, or an image signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively. Can generate signals.

Meanwhile, since the display device 100 shown in FIG. 1 is only an embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted according to the specifications of the display device 100 that is actually implemented.

That is, if necessary, two or more components may be combined into a single component, or one component may be subdivided into two or more components and configured. In addition, functions performed by each block are for explaining an embodiment of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

According to another embodiment of the present invention, unlike FIG. 1, the display apparatus 100 does not include a tuner 131 and a demodulation unit 132, but a network interface unit 133 or an external device interface unit ( 135) can also be received and played.

For example, the display device 100 is implemented by being divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content reproducing device for reproducing content input from the image processing device. Can be.

In this case, the method of operating the display device according to an embodiment of the present invention to be described below is not only the display device 100 as described with reference to FIG. 1, but also an image processing device or display unit 180 such as a separate set-top box. ) And the audio output unit 185 may be performed by any one of a content playback device.

Next, a remote control device according to an embodiment of the present invention will be described with reference to FIGS. 2 to 3.

2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 is a block diagram showing an example of an actual configuration of a remote control device according to an embodiment of the present invention.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 220 transmits and receives signals to and from any one of the display devices according to the exemplary embodiments described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard, and capable of transmitting and receiving signals with the display device 100 according to the IR communication standard. An IR module 223 may be provided. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals to and from the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 includes an NFC module 227 capable of transmitting and receiving signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and the display according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

On the other hand, the remote control device 200 may receive a signal transmitted from the display device 100 through the RF module 221, and power on/off the display device 100 through the IR module 223 as necessary. Commands for off, channel change, volume change, etc. can be transmitted.

The user input unit 230 may be composed of a keypad, a button, a touch pad, or a touch screen. A user may input a command related to the display device 100 to the remote control device 200 by manipulating the user input unit 230. When the user input unit 230 includes a hard key button, the user may input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be described with reference to FIG. 3.

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, A channel change button 237, a confirmation button 238, and a back button 239 may be included.

The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. As an example, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off power of the display apparatus 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the volume output by the display apparatus 100. The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

2 will be described again.

When the user input unit 230 includes a touch screen, the user may input a command related to the display device 100 to the remote control device 200 by touching a soft key on the touch screen. In addition, the user input unit 230 may include various types of input means that a user can manipulate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 may sense information on the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 is the moving speed of the remote control device 200 Information about the back can be sensed. On the other hand, the remote control device 200 may further include a distance measuring sensor, so that the distance to the display unit 180 of the display device 100 may be sensed.

The output unit 250 may output an image or audio signal corresponding to an operation of the user input unit 230 or a signal transmitted from the display apparatus 100. Through the output unit 250, the user may recognize whether the user input unit 230 is operated or whether the display apparatus 100 is controlled.

For example, the output unit 250 includes an LED module 251 that lights up when the user input unit 230 is operated or a signal is transmitted and received with the display device 100 through the wireless communication unit 220, and a vibration module that generates vibration ( 253), a sound output module 255 for outputting sound, or a display module 257 for outputting an image may be provided.

In addition, the power supply unit 260 supplies power to the remote control device 200, and when the remote control device 200 has not moved for a predetermined period of time, the power supply is stopped, thereby reducing power waste. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control device 200. If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores information about a frequency band through which signals can be wirelessly transmitted and received with the display device 100 paired with the remote control device 200 in the storage unit 270 and is referred to. can do.

The controller 280 controls all matters related to the control of the remote control device 200. The controller 280 transmits a signal corresponding to the operation of a predetermined key by the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 220. 100).

In addition, the voice acquisition unit 290 of the remote control device 200 may acquire voice.

The voice acquisition unit 290 may include at least one microphone 291, and may acquire a voice through the microphone 291.

Next, FIG. 4 will be described.

4 shows an example of using a remote control device according to an embodiment of the present invention.

4A illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the drawing, since the corresponding pointer 205 is moved and displayed according to movement in the 3D space, the remote control device 200 may be referred to as a space remote controller.

4B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left in response thereto.

Information on the movement of the remote control device 200 detected through a sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case where a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. Accordingly, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner.

Conversely, when the user moves the remote control device 200 to be close to the display unit 180, a selection area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selection area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selection area may be zoomed in.

In addition, when a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state in which a specific button in the remote control device 200 is not pressed, only the pointer 205 is moved according to the up, down, left, and right movement of the remote control device 200.

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200.

Meanwhile, in this specification, a pointer refers to an object displayed on the display unit 180 in response to an operation of the remote control device 200. Accordingly, the pointer 205 can be used to make objects of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, and a thick outline. In addition, the pointer 205 may be displayed in correspondence with any one of a horizontal axis and a vertical axis on the display unit 180, as well as a plurality of points such as a line and a surface. Do.

The display apparatus 100 according to an exemplary embodiment of the present invention may analyze a voice command using data stored in the storage unit 140 or analyze a voice command through communication with an NLP server (not shown).

When the display device 100 analyzes a voice command through an NLP server (not shown), the controller 170 transmits a voice command to an NLP server (not shown) through the wireless communication unit 173, and the NLP server performs a voice command. When the analysis result of is transmitted to the display apparatus 100, the display apparatus 100 may obtain information on the voice command by receiving the analysis result from the NLP server. For example, the control unit 170 may analyze whether the voice command contains a keyword, whether the voice command corresponds to a voice command that needs to provide a result for the keyword, etc. through communication with the NLP server. However, hereinafter, the communication process with the NLP server is omitted for convenience of description.

5 is a flowchart illustrating a method of operating a display device according to an embodiment of the present invention.

The voice acquisition unit 175 may receive a voice command (S11).

The voice command refers to words spoken by the user, and may include a command received so that the display apparatus 100 performs a specific operation.

According to an embodiment, the controller 170 may receive a trigger signal (eg, “Hi, LG”) through the voice acquisition unit 170 and then receive a voice command.

According to another embodiment, the controller 170 may receive a voice command after receiving a signal for selecting a specific button provided in the remote control device 200.

The controller 170 may receive a voice command through various methods other than the above-described embodiment.

Upon receiving the voice command, the controller 170 may determine whether a keyword for executing the specified function is included in the voice command (S13).

In this case, the controller 170 may determine whether the voice command includes a keyword for executing the designation function by transmitting not only the voice command but also information on which the keyword and the designation function are mapped to the NLP server.

Upon receiving the voice command, the controller 170 may determine whether a keyword is included in the received voice command, and the keyword may mean a command set in advance to execute a designated function. The keyword may include at least one of numbers, words, and sentences. That is, the keyword is a command that can be arbitrarily set by the user, and is not limited in its form, length, or language type.

The control unit 170 may be presetting a keyword for executing a specific function.

Specifically, the control unit 170 may receive a command for designating a user setting function to at least one keyword through the user input interface unit 150, and in this case, the storage unit 140 stores data in which the keyword and the designated function are mapped. ), you can set keywords for executing specific functions. The storage unit 140 may store keywords for executing a designated function.

6 is an exemplary diagram illustrating a method of presetting a keyword for executing a specific function by a display device according to an exemplary embodiment of the present invention.

The display unit 180 may display a keyword setting screen, and the keyword setting screen may include an additional icon 61, a reset icon 62, and preset keyword items 63 to 65 as shown in FIG. 6. However, this is merely an example for convenience of description.

The additional icon 61 may be an icon for additionally setting a keyword for executing a designation function. The control unit 170 may receive a command for selecting a keyword and a function after receiving a command for selecting the additional icon 61, and map the received keyword and function to the storage unit 140 Can be saved. When receiving the stored keyword, the controller 170 may set a function mapped to the keyword to be executed.

The reset icon 62 may be an icon for deleting or changing a preset keyword. When receiving a selection command for the reset icon 62, the controller 170 may delete at least one of preset keywords or set a set keyword or a designated function to be changed.

The preset keyword items 63 to 65 show keywords set in the display apparatus 100 and functions corresponding thereto. Referring to the example of FIG. 6, the preset keyword items 63 to 65 include the keyword “11” (63-1) and the assigned function “remote control setting 101” (63-2) and the keyword “ fun” (64-1) and the assigned function mapped to it “Play a fun movie” (64-2), the keyword “20000” (65-1), and the assigned function “Power off” (65-2) ) Can be included.

In this case, the control unit 170 controls the remote control setting to 101 when receiving the keyword “11”, performs a function to play an interesting movie when receiving the keyword “fun”, and turns off the power when receiving the keyword “20000” It can be controlled as much as possible.

According to the example of FIG. 6, in step S13, the controller 170 may determine whether a keyword such as “No. 11”, “fun” or “20000” is included in the voice command.

Again, FIG. 5 will be described.

If the voice command does not include a keyword for executing the specified function, the controller 170 may display information on the voice command uttered by the user (S15).

For example, if the keywords for executing the designated function stored in the storage unit 140 are “11”, “fun” and “20000”, the control unit 170 responds to the voice command “11 times” and “fun”. And it may be determined whether at least one of “20000” is included. If the voice command does not include “No. 11”, “fun” or “20000”, the control unit 170 may display information on the voice command uttered by the user.

The controller 170 may acquire a voice command through STT (Speech to Text).

Next, referring to FIG. 7, a method in which the controller 170 displays only information on a voice command will be described.

7 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information on a voice command.

Referring to the example of FIG. 7, when the microphone icon 1000 is selected, the controller 170 may receive a voice command. When the control unit 170 receives the voice command “What are you doing at number 10?” through the voice acquisition unit 175, the control unit 170 may acquire “what are you doing at number 10” as a voice command. In this case, since the keyword is not included in the voice command, the controller 170 may control the display 180 to display only the information 71 for channel 10, which is information about the voice command.

Again, FIG. 6 will be described.

On the other hand, if the voice command includes a keyword for executing the designation function, the controller 170 may determine whether it is a voice command that needs to provide a result for the keyword (S17).

For example, if the keywords for executing the designated function stored in the storage unit 140 are “11”, “fun” and “20000”, the control unit 170 responds to the voice command “11 times” and “fun”. And when at least one of “20000” is included, it may be determined that a keyword for executing the designation function is included in the voice command. In this case, the control unit 170 may determine whether the voice command is a voice command that needs to provide a result for the keyword.

Specifically, the control unit 170 performs morphological analysis, syntactic analysis, semantic analysis, and pragmatic analysis, etc., when analyzing voice commands. It may be determined that it is unnecessary to provide the result for the result keyword.

For example, when the voice command is “What is the meaning of the word fun?”, the control unit 170 includes the keyword “fun” as a result of analyzing the voice command, but the function mapped to the keyword “fun” is “fun movie. It can be judged that there is no connection to'play it on'. In this case, the control unit 170 may determine that the keyword is included in the voice command, but it is not a voice command that needs to provide a result for the keyword. In this case, the control unit 170 provides information on the voice command uttered by the user Only can be displayed.

However, as another example, when the voice command is “show me fun”, the control unit 170 includes the keyword “fun” as a result of analyzing the voice command, and the function “play a fun movie” mapped to the keyword “fun” It can be determined that there is a connection. In this case, the controller 170 may determine that a keyword is included in the voice command, and that the voice command is a voice command that needs to provide a result for the keyword.

When it is determined that the result for the keyword is a voice command that needs to be provided, the controller 170 may display at least one of information on a voice command uttered by the user and information on a designation function corresponding to the keyword (S19).

That is, if the keyword is included in the voice command, the controller 170 acquires information on the voice command and information on a designation function corresponding to the keyword, and receives at least one of information on the voice command and information on the designation function. Can be displayed.

According to the first embodiment, when determining that the result for the keyword is a voice command that needs to be provided, the control unit 170 may simultaneously display information on the voice command uttered by the user and information on a designation function corresponding to the keyword. have.

According to the second embodiment, when determining that the result for the keyword is a voice command that needs to be provided, the controller 170 sequentially displays information on the voice command uttered by the user and information on a designation function corresponding to the keyword. I can.

According to the third embodiment, when it is determined that the result for a keyword is a voice command that needs to be provided, the controller 170 displays information on a voice command uttered by the user and information on a designation function corresponding to the keyword in different sizes. can do.

Next, with reference to FIG. 8, a case in which the display device according to the first embodiment of the present invention displays at least one of information on a voice command and information on a designation function will be described.

8 is an exemplary diagram illustrating a case in which a display device according to an embodiment of the present invention simultaneously displays information on a voice command and information on a designation function.

Referring to the example of FIG. 8, when the microphone icon 1000 is selected, the control unit 170 receives a voice command “What are you doing at No. 11?” through the voice acquisition unit 175, and voices “What are you doing at No. 11”. Can be obtained by command. At this time, since the keyword “11” is included in the voice command, the control unit 170 provides information on channel 11, which is information about the voice command, and a designation function “remote control setting 101” corresponding to the keyword. The display unit 180 may be controlled to simultaneously display the information 82 on the channel 101, which is information.

Next, a case in which the display device according to the second embodiment of the present invention displays at least one of information on a voice command and information on a designation function will be described with reference to FIGS. 9 to 12.

9 is a flowchart illustrating a method of sequentially displaying information on a voice command and information on a designation function corresponding to a keyword by a display device according to an embodiment of the present invention.

9 may be a flow chart embodied in step S19 of FIG. 5. That is, when displaying at least one of information on a voice command uttered by a user and information on a designation function corresponding to a keyword, the controller 170 may follow the flowchart illustrated in FIG. 9.

The control unit 170 may determine whether priority is set for a voice command or a designated function (S101).

Here, the voice command may refer to a text obtained by converting the voice command itself, and the designation function may refer to a function set in response to a keyword included in the voice command. That is, the voice command may mean the objective meaning of the voice command itself, and the designation function may mean a hidden function of the voice command according to the keyword setting.

The controller 170 may obtain whether to set a priority for a voice command or a designated function.

According to an embodiment, the priority may be set as a default. For example, when the display apparatus 100 is manufactured, a designation function among voice commands and designation functions may be set as a default priority.

This is because most of the designation functions are arbitrarily set by the user, so if a keyword is included in the voice command, it can be assumed that the user spoke with the keyword in mind.

According to another embodiment, the priority may be set through a user command. The controller 170 may further receive a command for setting a priority for either information on a voice command or information on a designation function.

With reference to FIG. 10, a method of setting the priority by the control unit 170 through a priority setting command will be described.

10 is an exemplary diagram illustrating a method of setting a priority for information on a voice command or information on a designation function by a display device according to an embodiment of the present invention.

The control unit 170 may receive a priority setting command on the keyword setting screen. For example, priority may be set through a command to select any one of preset keyword items 63 to 65 displayed on the keyword setting screen.

In the example of FIG. 10, when receiving a command for selecting the keyword "fun" (64-1), the control unit 170 sets the voice command as priority, and is a designated function mapped to the keyword "fun" (64-1). When a command to select'Play a funny movie' (64-2) is received, the designated function can be set as a priority.

The controller 170 may control the display 180 to display a priority application icon 91 to information set as a priority. The user can easily check that the priority is set to any of the voice command and the designated function through the priority application icon 91.

In the case of FIG. 10, when receiving a voice command including “fun”, the controller 170 may determine that priority is set for the voice command.

If the priority is not set, the controller 170 may simultaneously display information on a voice command and information on a designation function corresponding to a keyword (S103).

On the other hand, when the priority is set, the control unit 170 may display only information corresponding to the priority among information on a voice command and information on a designation function (S105).

Here, the information corresponding to the priority may mean information related to a priority set among voice commands and keywords.

Meanwhile, the information corresponding to the lower priority may mean information related to a voice command and a keyword that is not set as a priority. The information corresponding to the subordinate priority may be information excluding information corresponding to the priority priority.

In the example of FIG. 10, when the control unit 170 receives a voice command such as “play fun”, information corresponding to a priority among information on a voice command and information on a designation function according to a keyword is It could be information.

11 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information corresponding to a priority.

The control unit 170 acquires all information on the voice command and information on the designation function corresponding to the keyword, and converts any one of the information on the voice command and the information on the designation function corresponding to the keyword as information corresponding to the priority. It can be classified, and the other can be classified as information corresponding to subordinate rankings.

In addition, as shown in FIG. 11, the control unit 170 may display only information 93 corresponding to the priority.

For example, if the voice command is “Play fun”, the information on the voice command is the result of analysis of the voice command'Play fun' itself, and program information about'fun' and the program'fun' can be viewed. It may include information on a link that exists, and information on a designation function corresponding to a keyword may include recommended movie items as a result of analysis of'play a funny movie'.

When only the information 93 corresponding to the prior priority is displayed, the controller 170 may control the display 180 to further display an icon 94 for converting to information corresponding to the lower priority.

When the controller 170 receives a selection command for the icon 94 for switching to information corresponding to the lower priority, the controller 170 may control the display 180 to display information corresponding to the lower priority instead of the information corresponding to the priority.

12 is an exemplary diagram when a display device according to an embodiment of the present invention displays only information corresponding to subordinate rankings.

When receiving a selection command of the icon 94 for switching to the information corresponding to the lower priority, the control unit 170 may not display the information 93 corresponding to the priority and display the information 95 corresponding to the lower priority. have.

In this way, when the priority is set, information corresponding to the priority is displayed first, thereby enabling the user to display preferred information more quickly.

Next, a case where the display device according to the third embodiment of the present invention displays at least one of information on a voice command and information on a designation function will be described with reference to FIGS. 13 to 14.

13 is a flowchart illustrating a method of displaying information on a voice command and information on a designation function corresponding to a keyword in different sizes by the display device according to an embodiment of the present invention. Likewise, FIG. 13 may be a flow chart embodied in step S19 of FIG. 5. That is, when displaying at least one of information on a voice command uttered by a user and information on a designation function corresponding to a keyword, the control unit 170 may operate according to the flowchart illustrated in FIG. 13.

The control unit 170 may determine whether priority is set for a voice command or a designated function (S201).

This is the same as described in step S101 and step S103 of FIG. 9, and thus a redundant description will be omitted.

If the priority is not set, the controller 170 may display information on a voice command and information on a designation function in the same size (S203).

On the other hand, if the priority is set, the control unit 170 may display information corresponding to the prior priority larger than information corresponding to the lower priority (S205).

14 is an exemplary diagram illustrating a case in which the display device according to an embodiment of the present invention displays information on a voice command and information on a designation function corresponding to a keyword in different sizes.

For example, when receiving the voice command “What are you doing at No. 11?”, the control unit 170 includes the keyword “No. 11” in the voice command, and the voice command has priority over the designated function according to the keyword. It can be determined that it is set. In this case, the control unit 170 acquires program information that is being broadcast in number 11 as information corresponding to the priority, and program information that is being broadcast on channel 101 as information corresponding to the subordinate priority, and stores information 98 corresponding to the priority. It can be displayed larger than the information 99 corresponding to the lower priority.

Meanwhile, the controller 170 may differently display at least one of not only the size, but also the position and the ratio according to the priority.

15 is a diagram illustrating a modified example of a method of displaying at least one of information on a voice command and information on a designation function by a display device according to an embodiment of the present invention.

In the foregoing, it has been described that the control unit 170 displays information on a voice command and information on a designation function corresponding to a keyword according to the voice command. However, the present invention is not limited thereto.

For example, when receiving a command for selecting a specific button from the remote control device 200, the control unit 170, when a specific button is set to a specific button, at least one of information on the selected specific button and information on the specified function. Can display one.

Referring to the example of FIG. 15, the display device 100 is set to switch to channel 5 when the '5' button is selected for less than a predetermined time through the remote control device 200, and the '5' button is set to If it is selected longer than the time, it may be set to execute a specific application. In this case, when receiving a selection command for the '5' button from the remote control device 200, the control unit 170 receives information on channel 5 96 and information on an application set corresponding to the '5' button 97 ) Can be displayed.

As described above, according to the present invention, there is an advantage in that information desired by the user can be more accurately and easily provided by variously displaying information related to the user command for any one user command.

Next, a method of operating a display device according to another exemplary embodiment of the present invention will be described with reference to FIGS. 16 to 21.

A display device according to another embodiment of the present invention relates to a method for more accurately displaying information on a channel intended by a user when receiving a voice command for uttering a channel number.

On the other hand, the flowchart shown in FIG. 5 and the flowchart shown in FIG. 16 to be described later are not separately classified, and each flowchart may be combined and implemented. That is, when receiving a voice command, the control unit 170 operates according to the flow chart shown in FIG. 16 when the channel number is included in the voice command, and operates according to the flow chart shown in FIG. 5 when the keyword is included in the voice command. can do.

16 is a flowchart illustrating a method of operating a display device according to another exemplary embodiment of the present invention.

The controller 170 may receive a voice command for uttering the channel number (S21).

When receiving the voice command, the controller 170 may obtain whether or not the channel number of the voice command is included. When the voice command includes a channel number, the controller 170 may determine that a voice command for uttering the channel number has been received.

The controller 170 may determine whether the channel number is a channel number for which a shortcut key has been set (S23).

The controller 170 may be setting a specific channel number as a shortcut key.

17 is an exemplary diagram of a method of setting a specific channel number as a shortcut key by the display device according to an embodiment of the present invention.

The remote control device 200 will be described on the assumption that it includes buttons 1 to 12.

As shown in FIG. 17, the controller 170 presses the 1 key for channel 211, the 2 key for channel 102, the 3 key for channel 103, the 4 key for channel 141, and key 5 for channel 151. Channel No.6, key No.6 for channel 161, key No.7 for channel 171, key No.8 for channel 181, key No.9 for channel 191, key No.10 for channel 200, key No.11 for channel 101 , You may be setting the shortcut key 12 to channel 222. In this case, the control unit 170 may switch the channel to the 211 channel when receiving a command for selecting the key 1 through the remote control device 200.

When the voice command includes a channel mode (eg, BS, CS1, CS2, etc.), the control unit 170 recognizes the channel mode and can display information on the channel according to the shortcut setting according to the channel mode. have.

On the other hand, when a shortcut key is set in this way, the user must enter the ternary input mode and select the number 1 key twice in succession in order to switch to the 11 channel. Here, the ternary input mode may be a mode in which a channel number is input so as to be converted to a channel number corresponding to the input physical key. Accordingly, the control unit 170 may switch the channel to the 11th channel when receiving the selection command of the 1st key twice in succession in the ternary input mode.

That is, in the ternary input mode, the controller 170 may switch to a channel corresponding to the input channel number, and in the case of the ternary input mode, the controller 170 may switch to a channel set as a shortcut key to the input channel number.

Again, Fig. 16 will be described.

If the channel number does not correspond to a channel number set as a shortcut key, the control unit 170 may display channel information according to a ternary input of the channel number (S25).

That is, if the channel number included in the voice command does not correspond to a channel number set as a shortcut key, the control unit 170 may display information on a channel to be switched when a ternary channel number is input.

For example, when a shortcut key is set as shown in FIG. 17, the controller 170 may display information on channel 13 when receiving a voice command for uttering channel number 13.

Meanwhile, if the channel number corresponds to a channel number with a shortcut key set, the control unit 170 may display channel information according to a ternary input of the channel number and chamfer information according to the shortcut key setting of the channel number (S27).

That is, if the channel number included in the voice command corresponds to a channel number set as a shortcut key, the control unit 170 provides information on the channel to be switched when the channel number is inputted in three terms, and the channel that is activated according to the channel number shortcut setting. Information can be displayed simultaneously.

For example, when a shortcut key is set as shown in FIG. 17, when receiving a voice command for firing channel number 1, the controller 170 provides information on channel 211 and key 1 for which the shortcut key is set. When ternary input is input, information on channel 1, which is the channel to be switched, can be displayed at the same time.

Next, FIG. 18 is an exemplary diagram of a method of displaying channel information according to a ternary input of a channel number by a display device according to an embodiment of the present invention.

For example, the control unit 170 may receive a voice command for uttering “channel 13”. The controller 170 may determine whether the channel number 13 included in the voice command is a channel number for which a shortcut key is set.

If the channel number 13 is not a channel number for which a shortcut key has been set, the controller 170 may control the display 180 to display information 51 on the channel 13, which is a channel according to a ternary input.

Hereinafter, displaying information on a specific channel may mean switching to a specific channel, searching for a specific channel to display information on the corresponding channel, searching for a broadcast on a specific channel and displaying broadcast information of the corresponding channel. .

FIG. 19 is a first exemplary diagram of a method of displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.

For example, the control unit 170 may receive a voice command for uttering “channel 11”. The controller 170 may determine whether the channel number 11 included in the voice command is a channel number for which a shortcut key is set.

If the channel number 11 is a channel number for which a shortcut key is set, the control unit 170 simultaneously transmits information 52 on the channel 11, which is a channel according to the ternary input, and the information 53 on the 101 channel, according to the shortcut setting for the channel number 11. The display unit 180 may be controlled to display.

The virtual number for the channel number 11 may be 101, and the physical number for the channel number 11 may be 11.

That is, if the channel number is a channel number for which a shortcut key is set, the controller 170 may control the display 180 to display channel information according to a ternary input of the channel number and channel information according to a shortcut key setting of the channel number.

FIG. 20 is a second exemplary diagram of a method of displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.

For example, the control unit 170 may receive a voice command for uttering “channel 11”. The controller 170 may determine whether the channel number 11 included in the voice command is a channel number for which a shortcut key is set.

If the channel number 11 is a channel number for which a shortcut key is set, the control unit 170 includes information on the channel including 11 according to the ternary input (54) (55) and information on the channel 101 according to the shortcut setting of the channel number 11 (56). The display unit 180 may be controlled to simultaneously display ).

The information on the channel including 11 according to the ternary input (54) (55) is (channel 11, channel 111) according to the physical channel number including the channel number (eg, 11) included in the voice command. It can mean information about.

That is, if the channel number is a channel number for which a shortcut key is set, the controller 170 may control the display 180 to display information of channels including a number according to a ternary input and channel information according to a shortcut setting of the channel number. .

FIG. 21 is a third exemplary diagram of a method for displaying channel information according to a ternary input of a channel number and channel information according to a shortcut key setting of a channel number, by a display device according to an embodiment of the present invention.

For example, the control unit 170 may receive a voice command for uttering “channel 11”. The controller 170 may determine whether the channel number 11 included in the voice command is a channel number for which a shortcut key is set.

If the channel number 11 is a channel number for which a shortcut key is set, the control unit 170 includes information on the channel including 11 according to the ternary input (41) (42), and information on the channel 101 according to the shortcut setting of the channel number 11 (43). ) And the display unit 180 to simultaneously display the information 44 on the application specified in button 11 according to the input of the ternary term.

The information on the channel including 11 according to the ternary input (41) (42) is the channel (channel 11, channel 111) according to the physical channel number including the channel number (for example, 11) included in the voice command. ) Can mean information.

The information 44 on the application designated at No. 11 according to the ternary input may mean information on the application set in response to the No. 11 button of the remote control device 200.

That is, if the channel number is a channel number for which a shortcut key is set, the control unit 170 includes information on channels including numbers according to the ternary input, channel information according to the shortcut setting of the channel number, and information on the application corresponding to the number according to the ternary input. The display unit 180 may be controlled to display.

According to the present invention, when the channel number according to the voice command is a channel number set as a shortcut key, information on the channel according to the ternary input and information on the channel according to the shortcut setting are all displayed. It is possible to minimize the omission of information about.

In addition, according to the present invention, there is an advantage of minimizing user inconvenience, such as inputting a channel number according to a shortcut key when a user wants to switch channels or inputting a channel number in a ternary input mode.

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (10)

A storage unit for storing keywords for executing a designation function;
A voice acquisition unit for receiving a voice command;
If the keyword is included in the voice command, a control unit that obtains information on the voice command and information on a designation function corresponding to the keyword; And
Including a display unit for displaying at least one of information on the voice command and information on the designated function
Display device. The method of claim 1,
The display unit
Simultaneously displaying information on the voice command and information on the designated function
Display device. The method of claim 1,
The control unit
Further receiving a priority setting command for any one of information on the voice command or information on the designated function
Display device. The method of claim 3,
The control unit
When priority is set for information on the voice command or information on the designated function, controlling the display to display only information corresponding to the priority
Display device. The method of claim 4,
The control unit
When only the information corresponding to the priority is displayed, controlling the display to further display an icon for switching to information corresponding to the lower priority
Display device. The method of claim 5,
The control unit
When receiving a command for selecting an icon for switching to information corresponding to the subordinate priority, controlling the display unit to display information corresponding to the subordinate priority instead of information corresponding to the priority
Display device. The method of claim 3,
The control unit
When a priority is set for the information on the voice command or the information on the designated function, controlling the display to display information corresponding to the priority higher than information corresponding to the lower priority
Display device. The method of claim 1,
The control unit
If the keyword is included in the voice command, determining whether the voice command is a voice command that needs to provide a result for the keyword
Display device. The method of claim 8,
The control unit
If it is a voice command for which the result of the keyword needs to be provided, at least one of information on the voice command and information on the designated function is displayed,
If it is not a voice command that needs to provide the result for the keyword, information on the voice command is displayed.
Display device. The method of claim 1,
The control unit
Receiving a command for designating a user-set function to at least one keyword, mapping the keyword and the specified function, and storing it in the storage unit,
The above keywords are
Containing at least one of numbers, words and sentences
Display device.

Images