KR102654415B1 - Display device and operating method thereof - Google Patents

Abstract

The present invention is to provide a display device that more accurately provides functions according to the voice command when receiving a voice command, and a method of operating the same. The display device includes a storage unit, a wireless communication unit for communicating with at least one external server, and a voice command. A receiving voice recognition unit, a control unit that acquires a function corresponding to a voice command received through the voice recognition unit, and receives data for executing the function from at least one of a storage unit and a wireless communication unit, providing data to execute the function. It may include a display unit that displays different voice command execution screens depending on the provider.

Description

Display device and operating method thereof {DISPLAY DEVICE AND OPERATING METHOD THEREOF}

The present invention relates to a display device and a method of operating the same, and more specifically, to a display device that provides a function according to a voice command upon receiving a voice command and a method of operating the same.

Recently, digital TV services using wired or wireless communication networks have become popular. Digital TV services can provide a variety of services that cannot be provided by existing analog broadcasting services.

For example, IPTV (Internet Protocol Television), a type of digital TV service, and smart TV service provide interactivity that allows users to actively select the type of program to watch and the viewing time. IPTV and smart TV services can provide various additional services, such as Internet search, home shopping, and online games, based on this interactivity.

Recently, as voice recognition-based artificial intelligence (AI) technology has rapidly spread, voice recognition technology is being applied to display devices. Accordingly, the display device can recognize the user's voice, and the user can more easily receive the desired service from the display device through voice commands.

Meanwhile, services provided by a display device may include services provided by an external server as well as services provided by the display device itself, and in this case, it is difficult for the user to know where and how the desired service is provided. Therefore, when a display device receives a voice command without the user specifying the type of service or service provider, there may be a need for a method to more accurately provide a service according to the voice command.

The present invention seeks to provide a display device that more accurately provides functions according to a voice command when receiving a voice command, and a method of operating the same.

The present invention seeks to provide a display device that can guide a user to the result of executing a function according to a voice command and information about a provider of a function according to the voice command when receiving a voice command, and a method of operating the same.

The present invention seeks to provide a display device that can easily obtain from a user information necessary for executing a function according to a voice command when receiving a voice command, and a method of operating the same.

A display device according to an embodiment of the present invention includes a storage unit, a wireless communication unit that communicates with at least one external server, a voice recognition unit that receives a voice command, and a function corresponding to a voice command received through the voice recognition unit. It may include a display unit that displays a voice command execution screen differently depending on the provider providing the data for executing the control unit function, which receives data for executing the function from at least one of the storage unit and the wireless communication unit.

When data for executing a function is received from the storage unit, the control unit displays a voice command execution screen including a TV provided screen on the display unit, and when data for executing a function is received from the wireless communication unit, the external server server is displayed on the display unit. A voice command execution screen including a provision screen can be displayed.

The control unit may display a voice command execution screen including an account access screen if the provider providing data for executing the function is an external server and account access is required to execute the function.

The control unit may display account information for receiving or guiding account information on the account access screen.

The control unit may display network connection information when data for executing a function cannot be received through the wireless communication unit.

If the control unit fails to obtain data to execute a function, it may display a search result screen for searching a voice command in the storage unit.

The control unit obtains a provider that provides data for executing the function depending on the setting country, and the provider providing data for executing the function may be different depending on the setting country.

If the setting country is the first country, the control unit recognizes the provider providing data for executing the function as the display device and the first external server, and if the setting country is the second country, it displays the provider providing data for executing the function. It can be recognized as a device and a second external server.

When the control unit receives a command to select a button provided in at least one of the display device and the remote control device for less than a standard time, it executes an app provided by an external server, and when it receives a command to select a button for more than a standard time, it recognizes voice. After displaying the screen, a data request signal to execute a function according to a voice command can be transmitted to an external server.

The control unit receives a voice command through a first button or a second button provided on at least one of the display device and the remote control device, and provides data for executing the function when the voice command is received through the first button. When a voice command is received through the and second buttons, the provider providing data for executing the function may be different.

According to an embodiment of the present invention, when receiving a voice command, the function according to the voice command can be provided through various providers such as the display itself and an external server, and the advantage is that the provider information can be guided to the user through different voice command execution screens. there is.

According to an embodiment of the present invention, when receiving a voice command, there is an advantage in that the function according to the voice command can be provided more quickly and accurately by displaying or requesting the information necessary to execute the function according to the voice command. .

According to an embodiment of the present invention, when a function according to a voice command requires account information, there is an advantage in that the function according to the user account can be provided through the account access screen.

According to an embodiment of the present invention, when a function according to a voice command must be provided from an external server but data cannot be received from the external server, there is an advantage in that network connection information can be displayed to facilitate the user's problem solving.

Figure 1 shows a block diagram of the configuration of a display device according to an embodiment of the present invention.
Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention.
Figure 3 shows an example of the actual configuration of a remote control device according to an embodiment of the present invention.
Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.
Figure 5 is a block diagram showing a configuration for explaining a method of executing a function corresponding to a voice command when a display device according to a first embodiment of the present invention receives a voice command.
Figure 6 is a block diagram showing a configuration for explaining a method of executing a function corresponding to a voice command when a display device according to a second embodiment of the present invention receives a voice command.
Figure 7 is a block diagram showing a configuration for explaining a method of executing a function corresponding to a voice command when a display device receives a voice command according to a third embodiment of the present invention.
Figure 8 is a flowchart showing a method of providing a function according to a voice command when a display device receives a voice command according to an embodiment of the present invention.
Figure 9 is a flowchart showing a method of recognizing an external server according to the setting country according to an embodiment of the present invention.
Figure 10 is an example diagram of a voice command execution screen when the function provider according to an embodiment of the present invention is a display device.
Figure 11 is an example diagram of a voice command execution screen when the function provider according to an embodiment of the present invention is an external server.
Figure 12 is an example diagram of receiving account information through an account access screen according to an embodiment of the present invention.
Figure 13 is an example diagram showing account information provided through an account access screen according to an embodiment of the present invention.
Figure 14 is an example diagram of a method for displaying network connection information according to an embodiment of the present invention.
Figure 15 is an example diagram of a search result screen according to a voice command according to an embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings.

The display device according to an embodiment of the present invention is, for example, an intelligent display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function while adding an Internet function, etc., and is a handwriting input device and a touch screen. Alternatively, it can be equipped with a more convenient interface such as a spatial remote control. In addition, by supporting wired or wireless Internet functions, it is possible to connect to the Internet and a computer and perform functions such as email, web browsing, banking, or gaming. A standardized general-purpose OS can be used for these various functions.

Accordingly, in the display device described in the present invention, for example, various applications can be freely added or deleted on a general-purpose OS kernel, so various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and in some cases, may also be applied to a smartphone.

Figure 1 shows a block diagram of the configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display device 100 includes a broadcast reception unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , may include a display unit 180, an audio output unit 185, and a power supply unit 190.

The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface unit 133.

The tuner 131 can select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a specific selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal to a form that can be output.

The external device interface unit 135 may receive an application or application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path with an external device. The external device interface unit 135 may receive one or more of video and audio output from an external device and transmit it to the control unit 170. An external device connectable to the external device interface unit 135 may be any one of a set-top box, Blu-ray player, DVD player, game console, sound bar, smartphone, PC, USB memory, or home theater.

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

Additionally, some of the content data stored in the display device 100 may be transmitted to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device 100.

The network interface unit 133 can access a certain web page through a connected network or another network linked to the connected network. In other words, you can access a certain web page through a network and transmit or receive data with the corresponding server.

And, the network interface unit 133 can receive content or data provided by a content provider or network operator. That is, the network interface unit 133 can receive content and related information such as movies, advertisements, games, VOD, and broadcast signals provided from a content provider or network provider through a network.

Additionally, the network interface unit 133 can receive firmware update information and update files provided by a network operator, and can transmit data to the Internet, a content provider, or a network operator.

The network interface unit 133 can select and receive a desired application from among applications that are open to the public through a network.

The storage unit 140 stores programs for processing and controlling each signal in the control unit 170, and can store signal-processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporary storage of video, voice, or data signals input from the external device interface unit 135 or the network interface unit 133, and may perform a predetermined storage function through the channel memory function. You can also store information about the image.

The storage unit 140 may store an application or application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 uses various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication. Control signals such as power on/off, channel selection, and screen settings can be received and processed from the remote control device 200, or control signals from the control unit 170 can be transmitted to the remote control device 200.

Additionally, the user input interface unit 150 can transmit control signals input from local keys (not shown) such as power key, channel key, volume key, and setting value to the control unit 170.

The image signal processed by the control unit 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

The voice signal processed by the control unit 170 may be output as audio to the audio output unit 185. Additionally, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the control unit 170 may control overall operations within the display device 100.

In addition, the control unit 170 can control the display device 100 by a user command or internal program input through the user input interface unit 150, and connects to the network to display an application or application list desired by the user on the display device. You can download it within (100).

The control unit 170 allows channel information selected by the user to be output through the display unit 180 or the audio output unit 185 along with the processed video or audio signal.

In addition, the control unit 170 controls the external device image playback command received through the user input interface unit 150, from an external device, for example, a camera or camcorder, input through the external device interface unit 135. A video signal or audio signal can be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 can control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131, or an external input input through the external device interface unit 135. An image, an image input through the network interface unit, or an image stored in the storage unit 140 can be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or 3D image.

Additionally, the control unit 170 can control the playback of content stored in the display device 100, received broadcast content, or external input content, which may include broadcast video, external input video, or audio files. , can be in various forms such as still images, connected web screens, and document files.

The wireless communication unit 173 can communicate with external devices through wired or wireless communication. The wireless communication unit 173 can perform short range communication with an external device. To this end, the wireless communication unit 173 uses Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi. Short-distance communication can be supported using at least one of (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication unit 173 is connected between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks where the display device 100 (or an external server) is located can be supported. Local area wireless networks may be wireless personal area networks.

Here, the other display device 100 is a wearable device capable of exchanging data with (or interoperating with) the display device 100 according to the present invention, for example, a smartwatch, smart glasses. It can be a mobile terminal such as (smart glass), HMD (head mounted display), or smart phone. The wireless communication unit 173 may detect (or recognize) a wearable device capable of communication around the display device 100. Furthermore, if the detected wearable device is a device authenticated to communicate with the display device 100 according to the present invention, the control unit 170 sends at least part of the data processed by the display device 100 to the wireless communication unit 173. It can be transmitted to a wearable device. Accordingly, a user of a wearable device can use data processed by the display device 100 through the wearable device.

The display unit 180 converts the video signal, data signal, and OSD signal processed by the control unit 170 or the video signal and data signal received from the external device interface unit 135 into R, G, and B signals, respectively, and operates them. A signal can be generated.

Meanwhile, the display device 100 shown in FIG. 1 is only one embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device 100 that is actually implemented.

That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed by each block are for explaining embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.

According to another embodiment of the present invention, unlike shown in FIG. 1, the display device 100 does not have a tuner 131 and a demodulation unit 132, but includes a network interface unit 133 or an external device interface unit ( You can also receive and play video through 135).

For example, the display device 100 is divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content playback device for playing content input from the image processing device. It can be implemented.

In this case, the method of operating a display device according to an embodiment of the present invention, which will be described below, includes not only the display device 100 as described with reference to FIG. 1, but also an image processing device such as the separated set-top box or a display unit ( 180) and a content playback device including an audio output unit 185.

Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present invention will be described.

Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention, and Figure 3 shows an example of the actual configuration of a remote control device according to an embodiment of the present invention.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 225 transmits and receives signals to and from any one of the display devices according to the embodiments of the present invention described above.

The remote control device 200 has an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to RF communication standards, and an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to IR communication standards. An IR module 223 may be provided. Additionally, the remote control device 200 may be equipped with a Bluetooth module 225 that can transmit and receive signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 is equipped with an NFC module 227 capable of transmitting and receiving signals to the display device 100 according to the NFC (Near Field Communication) communication standard, and displays the display device 100 according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

Meanwhile, the remote control device 200 can receive signals transmitted by the display device 100 through the RF module 221 and, if necessary, turn on/off the display device 100 through the IR module 223. Commands for turning off, changing channels, changing volume, etc. can be sent.

The user input unit 230 may be comprised of a keypad, button, touch pad, or touch screen. The user can input commands related to the display device 100 into the remote control device 200 by manipulating the user input unit 230. If the user input unit 230 is provided with a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be explained with reference to FIG. 3 .

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button (212), power button (231), home button (232), live button (233), external input button (234), volume control button (235), voice recognition button (236), It may include a channel change button 237, a confirmation button 238, and a back button 239.

The fingerprint recognition button 212 may be a button for recognizing the user's fingerprint. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the sound output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to the previous screen.

Figure 2 will be described again.

If the user input unit 230 has a touch screen, the user can input commands related to the display device 100 through the remote control device 200 by touching a soft key on the touch screen. Additionally, the user input unit 230 may be equipped with various types of input means that the user can operate, such as scroll keys and jog keys, and this embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 measures the moving speed of the remote control device 200. Information about such things can be sensed. Meanwhile, the remote control device 200 may further include a distance measurement sensor and can sense the distance from the display unit 180 of the display device 100.

The output unit 250 may output a video or audio signal corresponding to an operation of the user input unit 235 or a signal transmitted from the display device 100. Through the output unit 250, the user can recognize whether the user input unit 235 is operated or whether the display device 100 is controlled.

For example, the output unit 250 includes an LED module 251 that lights up when the user input unit 235 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 225, and a vibration module that generates vibration ( 253), a sound output module 255 that outputs sound, or a display module 257 that outputs an image.

In addition, the power supply unit 260 supplies power to the remote control device 200, and stops power supply when the remote control device 200 does not move for a predetermined period of time, thereby reducing power waste. The power supply unit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, etc. necessary for controlling or operating the remote control device 200. If the remote control device 200 transmits and receives signals wirelessly through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores and references information about the display device 100 paired with the remote control device 200 and the frequency band for wirelessly transmitting and receiving signals in the storage unit 270. can do.

The control unit 280 controls all matters related to the control of the remote control device 200. The control unit 280 sends a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100).

Additionally, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

The voice acquisition unit 290 may include at least one microphone 291 and can acquire voice through the microphone 291.

Next, Figure 4 will be described.

Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

(a) of FIG. 4 illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. This remote control device 200 can be called a spatial remote control because the corresponding pointer 205 is moved and displayed according to movement in 3D space, as shown in the drawing.

(b) of FIG. 4 illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display device 100 may display the pointer 205 to correspond to the calculated coordinates.

(c) of FIG. 4 illustrates a case where a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. As a result, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed enlarged.

Conversely, when the user moves the remote control device 200 closer to the display unit 180, the selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selected area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Additionally, when a specific button in the remote control device 200 is pressed, recognition of up-down, left-right movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves as the remote control device 200 moves up, down, left, and right.

Meanwhile, the moving speed or direction of the pointer 205 may correspond to the moving speed or direction of the remote control device 200.

Meanwhile, a pointer in this specification refers to an object displayed on the display unit 180 in response to the operation of the remote control device 200. Accordingly, the pointer 205 can be an object of various shapes other than the arrow shape shown in the drawing. For example, concepts may include dots, cursors, prompts, thick outlines, etc. In addition, the pointer 205 can be displayed in correspondence to one of the horizontal and vertical axes on the display unit 180, as well as in response to multiple points, such as a line or surface. do.

When the display device 100 according to an embodiment of the present invention receives a voice command, it can obtain data related to the function according to the voice command and display a voice command execution screen.

Meanwhile, when a display device receives a voice command, it can obtain data related to the function according to the voice command in various ways. Next, with reference to FIGS. 5 to 7 , a method for a display device to obtain data related to a function according to a voice command will be described.

Figure 5 is a block diagram showing a configuration for explaining a method of obtaining data related to a function according to a voice command when the display device according to the first embodiment of the present invention receives a voice command.

According to the first embodiment of the present invention, the display device 100 includes a voice recognition unit 171 that recognizes voice commands, and a wireless communication unit 173 that transmits and receives signals with a provider that provides functions corresponding to voice commands. ), a control unit 170 for executing a function corresponding to a voice command, and an output unit 186 for executing the function, and the output unit 186 is a display unit for visually outputting the execution result of the function ( 180) and an audio output unit 185 that audibly outputs the execution result of the function.

According to the first embodiment of the present invention, the display device 100 may further include a determination module 10 that determines a provider that provides a function corresponding to a voice command. However, each component shown in FIG. 5 shows only the main components for convenience of explanation, and the display device 100 may include more or fewer components than the components shown in FIG. 5 .

Depending on the embodiment, the determination module 10 may be provided in the display device 100 or in the internal NLP server 15. According to the first embodiment of the present invention, the discrimination module 10 may be provided inside the display device 100, and according to the second to third embodiments of the present invention described later, the discrimination module 10 may be installed inside the display device 100. It may be provided in the NLP server 15.

The determination module 10 is a component that determines the provider that provides the function corresponding to the voice command. The determination module 10 can determine the provider that provides data related to the function corresponding to the voice command. . The determination module 10 can determine the provider who provided the data for executing the function according to the voice command.

The voice recognition unit 171 may include a voice input unit (not shown) such as a microphone to receive a user's voice command.

The voice input unit (not shown) may be provided as a separate component from the voice recognition unit 171. For example, a voice input unit (not shown) may be included in the user input interface unit 150 described in FIG. 1 .

The voice recognition unit 171 may process the user's voice command input through the microphone into electrical voice data.

When the voice recognition unit 171 receives the user's voice command, it can transmit the user's voice command to the internal STT server 13. The internal STT server 13 can convert voice data included in the voice command into text data in text format and transmit it to the voice recognition unit 171.

Here, the internal STT server 13 may refer to an STT (Speech-to-Text) server that is connected to the display device 100 and converts voice commands received by the display device 100 into text data. Since it is simply named the internal STT server to distinguish it from the STT server provided in the external server, which will be described later, the name is not limited.

The internal STT server 13 and the internal NLP server 15 described later may be connected to the display device 100 through the network interface unit 133.

The voice recognition unit 171 can transmit a voice command converted to text data to the control unit 170, and the control unit 170 can acquire a function corresponding to the voice command by analyzing the voice command converted to text data. . In other words, the control unit 170 can analyze what function the user entered through a voice command is.

Here, the function may mean a service that can be provided by running on the display device 100, and includes not only essential services required for the operation of the display device 100 but also ancillary services provided for purposes such as convenience and fun. can do. For example, functions may include channel/volume change, screen settings, content search, application-related services, gallery mode, and IOT (Internet of Things)-related services.

The determination module 10 can determine the provider that provides the function corresponding to the voice command.

The function may be a function provided by the display device 100 itself or a function provided by at least one external server.

For example, the function provided by the display device 100 is a function that can be executed based on at least one of data received through the broadcast receiver 130 and internal data stored in the storage unit 140, and is executed by an external server. The provided function may be a function that can be executed based on data received through the wireless communication unit 173.

The determination module 10 may determine whether the provider providing the function corresponding to the voice command is the display device 100, the first external server 50, or the second external server 60.

The determination module 10 transmits a voice command converted into text data to the internal NLP server 15, and the internal NLP server 15 may receive a voice command in the form of text data from the determination module 10. The internal NLP server 15 can mechanically analyze voice commands in the form of text data to obtain the intended function of the text data. The internal NLP server 15 may transmit the acquired function to the determination module 10.

Similarly, here, the internal NLP server 15 may refer to an NLP (Natural Language server) server that is connected to the display device 100 and analyzes the user's intention according to the voice command input to the display device 100, which will be described later. Since it is simply named as an internal NLP server to distinguish it from the NLP server provided on an external server, the name is not limited.

The internal NLP server 15 can analyze voice commands in the form of text data based on data stored in an already established natural language recognition processing database. For example, the internal NLP server 15 may acquire a function corresponding to the voice command by comparing text data according to the voice command with data built in a natural language recognition processing database and analyzing whether matching letters exist. However, this is only an example, and the internal NLP server 15 can acquire functions corresponding to voice commands in various ways.

The internal NLP server 15 transmits the function corresponding to the voice command to the determination module 10, and the determination module 10 can determine the provider of the function corresponding to the voice command.

According to one embodiment, the determination module 10 may store a table mapping a plurality of functions and the provider of each function, and may determine the provider corresponding to the acquired function based on the table.

According to another embodiment, the determination module 10 may store execution information of each function executed in the display device 100, and may obtain the provider of the function through the stored execution information. In addition, the determination module 10 can determine the provider of the function corresponding to the voice command in various ways.

Meanwhile, depending on the embodiment, the internal NLP server 15 may acquire both the function corresponding to the voice command and the provider providing the function and transmit them to the determination module 10.

The internal NLP server 15 may transmit the function information corresponding to the voice command and the provider information to the determination module 10 as one signal, or the function information corresponding to the voice command and the provider information may be transmitted as separate signals. You can also send it.

The control unit 170 may determine whether the provider of the acquired function is a specific external server or the display device 100.

If the control unit 170 determines that the function provider is the first external server 50, it transmits a data request signal to the first external server 50, and if it determines that the function provider is the second external server 60, the control unit 170 transmits a data request signal to the first external server 50. A data request signal can be transmitted to the external server 60.

Here, the data request signal may be a signal requesting data to execute a function corresponding to a voice command.

The wireless communication unit 173 can transmit and receive data with at least one external server. For example, the wireless communication unit 173 may transmit and receive data with the first external server 50 and the second external server 60, but this is merely an example. The wireless communication unit 173 may transmit and receive signals with two or more external servers.

The wireless communication unit 173 may transmit a data request signal requesting data for executing a specific function to at least one external server, and may receive a function data signal in response to the data request signal.

Here, the function data signal may mean data related to the function according to the data request signal, and may include data used to execute the function according to the data request signal.

When receiving a data request signal, the first external server 50 or the second external server 60 may obtain data related to a function according to the data request signal and transmit the function data signal to the display device 100. Data related to a function may refer to data required to execute the function.

According to the first embodiment, the first external server 50 and the second external server 60 may not include an STT server and an NLP server. Therefore, the wireless communication unit 173 transmits a data request signal containing function information according to the voice command to one of the external servers 50 and 60 based on the decision result of the determination module 10, and the external server ( 50)(60) may transmit data for executing the function included in the received data request signal to the wireless communication unit 173. In other words, the external server 50, 60 can transmit the function data signal without analyzing the function according to the voice command.

The function data signal corresponding to the voice command may refer to a signal containing data related to the function corresponding to the voice command. That is, the external servers 50 and 60 may transmit data necessary for executing a function corresponding to a voice command to the display device 100 through a function data signal.

Meanwhile, if the control unit 170 determines that the provider of the function is the display device 100, it can obtain data related to the function from the storage unit 140. Alternatively, if the provider of the function is the display device 100, the control unit 170 may obtain data related to the function from at least one of the network interface unit 133 and the external device interface unit 135. Hereinafter, when the provider of the function is the display device 100, it will be explained that the control unit 170 obtains data related to the function from the storage unit 140, but this is for convenience of explanation and is not limited thereto.

In this case, the control unit 170 executes the function according to the voice command through data included in the function data signal received from the external server 50, 60, and the output unit 186 displays the result of executing the function on the display unit. It can be output through at least one of the audio output unit 180 and the audio output unit 185.

That is, according to the first embodiment of the present invention, the control unit 170 can obtain the function according to the voice command and the provider of the function according to the voice command through the determination module 10 provided therein. In addition, since the display device 100 has a determination module 10 inside and does not communicate with servers that are not related to functions corresponding to voice commands, it is necessary to send data analyzed by voice commands to another server. Security can be strengthened due to the absence of traffic, and traffic reduction is achieved by shortening data transmission time and reducing line distance.

Figure 6 is a block diagram showing a configuration for explaining a method of executing a function corresponding to a voice command when a display device according to a second embodiment of the present invention receives a voice command.

Figure 6 shows the main configuration of the display device 100 according to the second embodiment of the present invention. The display device 100 includes a voice recognition unit 171, a wireless communication unit 173, an output unit 186, and It may include a control unit 170. At this time, the display device 100 may be connected through the wireless communication unit 173 without having the determination module 10 inside, and the determination module 10 may be provided in the internal NLP server 15.

Since the same description as that described in FIG. 5 is redundant, it will be omitted.

The wireless communication unit 173 may communicate with at least one external server 50 or 60, and the external server 50 or 60 may communicate with the internal NLP server 15.

The determination module 10 provided in the internal NLP server 15 determines the provider of the function corresponding to the voice command and transmits it to the external servers 50 and 60, and the external servers 50 and 60 are internal NLP servers. The function provider information received from (15) can be transmitted to the display device 100.

According to the second embodiment of the present invention, the external servers may include an STT server and an NLP server, respectively. That is, the first external server 50 includes a first STT server 53 and a first NLP server 55, and the second external server 60 includes a second STT server 63 and a second NLP server ( 65) may be included. The external servers are each equipped with an STT server and an NLP server, so the external server can determine the function and provider of the function corresponding to the voice command.

Accordingly, the control unit 170 transmits the voice command to the first external server 50 and the second external server 60, and each of the first external server 50 and the second external server 60 responds to the voice command. You can acquire the function to

According to one embodiment, the control unit 170 may directly transmit a voice command received through a voice input unit such as a microphone to the first external server 50 and the second external server 60. That is, the control unit 170 can transmit a voice command in the form of voice data to the first external server 50 and the second external server 60. In this case, the first external server 50 and the second external server 60 convert the voice command into text data through the STT server provided in each, and the NLP server analyzes the converted text data and responds to the voice command. You can obtain the function:

According to another embodiment, the control unit 170 may transmit a voice command converted into text data form to the first external server 50 and the second external server 60 through the internal STT server 13. In this case, the first external server 50 and the second external server 60 can acquire the function of a voice command through the NLP server provided in each.

According to another embodiment, the control unit 170 may transmit a voice command in the form of text data and a voice command in the form of voice data to the first external server 50 and the second external server 60. In this case, the first external server 50 and the second external server 60 convert the voice command into text data through the STT server provided in each, and convert the converted text data into text received from the display device 100. It can be compared with data. The STT servers of the first external server 50 and the second external server 60 can reanalyze the voice command if the converted text data and the received text data are different as a result of comparison, thereby improving the analysis accuracy of the voice command. There is an advantage to this. Thereafter, the NLP servers of the first external server 50 and the second external server 60 may analyze the converted text data to obtain a function corresponding to the voice command.

The first external server 50 and the second external server 60 may each acquire a function corresponding to a voice command and then obtain a provider that provides the acquired function.

The first external server 50 and the second external server 60 each transmit information about the acquired function to the internal NLP server 15, and the internal NLP server 15 uses the determination module 10 provided therein. You can determine the provider that provides the acquired function. For example, the determination module 10 may determine that the function provider is one of the display device 100, the first external server 50, and the second external server 60.

After determining the provider of the function, the internal NLP server 15 may transmit information about the provider of the determined function to the first external server 50 and the second external server 60. In this way, the first external server 50 and the second external server 60 can obtain the provider of the function corresponding to the voice command through the determination module 10 provided in the internal NLP server 15.

Meanwhile, depending on the embodiment, the NLP servers 55 and 65 provided in the first external server 50 and the second external server 60 may be provided with a determination module 10, and in this case, the first external server 50 and the second external server 60 may be provided with a determination module 10. The server 50 and the second external server 60 may determine the provider of the function.

The first external server 50 determines whether the provider of the acquired function is the first external server, and if the provider of the function is the first external server, obtains data related to the function corresponding to the voice command, and displays the display device 100. It is possible to transmit a functional data signal corresponding to a voice command. Meanwhile, the first external server 50 may not perform any operation if the function provider is not the first external server.

Additionally, according to another embodiment, when the function provider is not the first external server, the first external server 50 may transmit a message indicating that the function provider is not the first external server to the display device 100. . In this case, the display device 100 may determine that the function corresponding to the voice command is unrelated to the first external server 50.

Likewise, the second external server 60 determines whether the provider of the acquired function is the second external server, and if the provider of the function is the second external server, obtains data related to the function corresponding to the voice command, and displays the device ( 100), a function data signal corresponding to a voice command can be transmitted, and the second external server 60 does not perform any operation if the function provider is not the second external server, or if the function provider is not the second external server. A message indicating that it is not may be transmitted to the display device 100.

The control unit 170 determines whether the function data signal has been received, and when the function data signal is received, the control unit 170 may execute a function corresponding to the voice command based on data related to the function included in the function data signal. Meanwhile, if the control unit 170 does not receive the function data signal, the control unit 170 may obtain function-related data from the storage unit 140 and execute the function corresponding to the voice command.

Figure 7 is a block diagram showing a configuration for explaining a method of executing a function corresponding to a voice command when a display device receives a voice command according to a third embodiment of the present invention.

Figure 7 shows the main configuration of the display device 100 according to the third embodiment of the present invention. The display device 100 includes a voice recognition unit 171, a wireless communication unit 173, an output unit 186, and It may include a control unit 170 and may further include a keyword determination unit 17. At this time, the determination module 10 may be provided in the internal NLP server 15 similar to that described with reference to FIG. 6.

Since the same description as that described in FIG. 5 or FIG. 6 is redundant, it will be omitted.

The voice recognition unit 171 may receive a voice command through a voice input unit such as a microphone, transmit the voice command in the form of voice data to the internal STT server, and convert it into text data.

The keyword determination unit 17 may receive a voice command in the form of voice data or a voice command in the form of text data from the voice recognition unit 171.

The keyword determination unit 17 can recognize a preset keyword from the received voice command.

The control unit 170 may set keywords in advance. At this time, the control unit 170 can set different keywords for each provider providing the function. The storage unit 140 may store keywords set differently for each of the display device 100 and the external server.

The control unit 170 may set different keywords for each of the first external server 50, the second external server 60, and the display device 100. The control unit 170 may set a first keyword corresponding to the first external server 50, a second keyword corresponding to the second external server 60, and a third keyword corresponding to the display device 100, , For example, the first keyword may be “Hey”, the second keyword may be “Execute”, and the third keyword may be “Hi, TV”, but this is only an example and does not need to be limited thereto.

The control unit 170 can recognize a preset keyword from a voice command in the form of voice data or a voice command in the form of text data, and when a specific keyword is recognized, it determines that the provider corresponding to the recognized keyword is the provider of the function according to the voice command. And, data related to the function corresponding to the voice command can be received from the provider of the determined function.

That is, the control unit 170 determines whether the provider of the function corresponding to the voice command is the first external server 50, the second external server 60, or the display device 100 based on the recognized keyword, and determines whether the function corresponding to the voice command is provided by the display device 100. If the provider of is determined to be the first external server, a data request signal is transmitted to the first external server 50 to receive data related to the function from the first external server 50, and the provider of the function corresponding to the voice command is the first external server. 2 If it is determined to be an external server, a data request signal is transmitted to the second external server 60, data related to the function is received from the second external server 60, and the provider of the function corresponding to the voice command is sent to the display device 100. If determined, data related to the function corresponding to the voice command can be obtained from the storage unit 140.

Meanwhile, depending on the embodiment, the display device 100 and the first external server 50 may check whether the first external server 50 is the provider of the function according to the data request signal. Specifically, the first external server 50 may receive the determination result of the determination module 10 provided in the internal NLP server 15 through communication with the internal NLP server 15 and reconfirm the provider of the function. That is, the first external server 50 can reconfirm the provider of the function by comparing whether the provider of the function determined through the keyword determination unit 17 matches the provider of the function determined through the determination module 10. The first external server 50 may transmit the re-verification result to the display device 100, and the display device 100 may respond to the voice command only if the first external server 50 is the function provider based on the re-verification result. Data related to the corresponding function may be received from the first external server 50 and executed.

Likewise, depending on the embodiment, the display device 100 and the second external server 60 may check whether the second external server 60 is the provider of the function according to the data request signal. Specifically, the second external server 60 may receive the determination result of the determination module 10 provided in the internal NLP server 15 through communication with the internal NLP server 15 and reconfirm the provider of the function. That is, the second external server 60 can reconfirm the provider of the function by comparing whether the provider of the function determined through the keyword determination unit 17 matches the provider of the function determined through the determination module 10. The second external server 60 may transmit the re-verification result to the display device 100, and the display device 100 may respond to the voice command only if the second external server 60 is the function provider based on the re-verification result. Data related to the corresponding function may be received from the second external server 60 and executed.

Meanwhile, in Figures 5 to 7, an example is given in which only the first external server 50 and the second external server 60 exist as external servers, and the display device 100 includes the first and second external servers ( 50) It is not limited to (60), and it is possible to determine whether each of a plurality of external servers with which communication is possible is a provider of the function.

Figure 8 is a flowchart showing a method of providing a function according to a voice command when a display device receives a voice command according to an embodiment of the present invention.

The control unit 170 can receive a voice command (S11).

The control unit 170 may receive a user's voice command through the voice recognition unit 171.

Specifically, at least one of the display device 100 and the remote control device 200 linked to the display device 100 may include a voice input unit (not shown) that receives a voice command, such as a microphone, and a voice recognition unit. (171) can receive a voice command through a voice input unit (not shown).

The control unit 170 may receive a voice command through a command to select a button provided on at least one of the display device 100 and the remote control device 200.

According to one embodiment, the display device 100 and the remote control device 200 may have only one button for receiving a voice command.

For example, the control unit 170 may receive a voice command through a command to select a specific button provided on at least one of the display device 100 and the remote control device 200.

As another example, when the control unit 170 receives a command to select a specific button provided in at least one of the display device 100 and the remote control device 200 for less than a reference time, the control unit 170 executes an app provided by an external server and executes a specific button. When a command to select a button is received for more than a standard time, a voice recognition screen is displayed and a data request signal for executing a function according to the voice command can be transmitted from an external server. That is, in this case, the control unit 170 can receive a voice command through a command to select a specific button that can run the app for a reference time or longer.

According to another embodiment, the display device 100 and the remote control device 200 may have two or more buttons for receiving voice commands.

For example, the control unit 170 may receive a voice command through a first button or a second button provided on at least one of the display device 100 and the remote control device 200, and the control unit 170 may receive a voice command When a voice command is received through button 1, the provider providing data for executing the function may be obtained differently from the provider providing data for executing the function when receiving a voice command through the second button. For example, when a voice command is received through the first button, the control unit 170 transmits a data request signal for executing the function to the first external server, and when a voice command is received through the second button, the control unit 170 performs the function. A data request signal for execution may be transmitted to a second external server.

As such, according to an embodiment of the present invention, even if a voice command is received through at least one button without specifying the entity executing the function, data for executing the function is transmitted to the display device or any one through analysis of the voice command. Since it can be received from an external server, the user has the advantage of being able to easily receive the desired service without having to specify the entity executing the function.

However, the method described above is only an example for convenience of explanation, and the type of button, method of selecting the button, number of buttons, etc. may vary.

The control unit 170 may obtain the function and the provider of the function corresponding to the voice command (S13).

The control unit 170 may obtain a function and a function provider corresponding to a voice command received through the voice recognition unit 171. The control unit 170 can acquire functions and function providers through at least one method described with reference to FIGS. 5 to 7 . Since the method for acquiring the function has already been described with reference to FIGS. 5 to 7, redundant description will be omitted.

Depending on the function provider, the control unit 170 may obtain data for executing the function through at least one of the storage unit 140 and the wireless communication unit 173.

The control unit 170 may determine whether the function can be processed within the display device (S13).

That is, the control unit 170 can determine whether the function provider is the display device.

If the function can be processed inside the display device, the control unit 170 can execute the function corresponding to the voice command based on the internal data (S17).

If the function is a function that can be processed inside the display device, the control unit 170 can obtain data for executing the function from the storage unit 140 and execute the function based on the data obtained from the storage unit 140. there is.

Meanwhile, if the function does not correspond to a function that can be processed inside the display device, the control unit 170 may determine whether the function can be processed by the external server 50 or 60 (S13).

The control unit 170 may obtain whether the function corresponds to a function that can be processed by the external server 50 (60).

However, the order of steps S15 and S19 may be changed.

If the function does not correspond to a function that can be processed by the external server 50 or 60, the control unit 170 may display the result of searching for a voice command on the display device 100 (S31).

If the function is a function that cannot be processed by either the display device 100 or the external server 50 or 60, the control unit 170 may display the results of searching for a voice command.

That is, when the control unit 170 fails to obtain data for executing a function, it may display a search result screen for searching a voice command in the storage unit 140.

For example, the control unit 170 may display a search result screen containing result information of searching text corresponding to a voice command in at least one of the storage unit 140, a specific application, and the web.

In this case, the display device has the advantage of being able to provide services requested by the user to the maximum extent possible even if it cannot execute functions according to voice commands.

If the function is a function that can be processed by the external server 50 or 60, the control unit 170 transmits a data request signal to the external server 50 or 60 (S21) and sends a function data signal corresponding to the data request signal. It can be received from the external server 50 or 60 (S23).

That is, if the function is a function that can be processed by the external server 50 or 60, the control unit 170 can obtain data for executing the function from the external server 50 or 60.

The control unit 170 determines whether account access is necessary (S25), and if account access is necessary, receives account information through the account access screen (S27) and then executes a function corresponding to the voice command based on the function data signal. There is (S29). Meanwhile, if account access is not required, the control unit 170 can immediately execute a function corresponding to a voice command based on the function data signal (S29).

The control unit 170 may determine whether account access is necessary to execute a function.

Specifically, when the external server 50 or 60 requires account information to execute a function, it transmits an account request signal to the display device 100, and the control unit 170 operates based on whether or not the account request signal is received. This allows you to determine whether account access is necessary.

If the control unit 170 receives a function data signal without receiving an account request signal, the control unit 170 may determine that account access is not necessary and execute the function based on data obtained through the function data signal.

When receiving an account request signal, the control unit 170 determines that account access is necessary, receives account information through the account access screen, transmits the received account information to the external server 50, 60, and then transmits the account information according to the account information. Functions can be executed by receiving function data signals.

Depending on the embodiment, the control unit 170 may obtain the presence or absence of pre-stored account information when receiving an account request signal. If there is no pre-stored account information, the control unit 170 may receive account information through the account access screen. If there is pre-stored account information, the control unit 170 may display an account access screen to confirm whether it is correct to execute the function using the stored account information. If there is pre-stored account information, the control unit 170 can transmit the pre-stored account information to the external server 50 (60) to receive function data signals according to the account information and execute the function.

The control unit 170 displays a voice command execution screen described later when executing a function corresponding to a voice command based on internal data and when executing a function corresponding to a voice command based on a function data signal received from an external server. It can be displayed differently.

That is, the control unit 170 may output functions differently depending on the provider who provided data related to the function. Specifically, the control unit 170 may control the output form of the function differently depending on the provider, even if the type of function is the same. For example, even if the type of function is the same as 'search', the control unit 170 executes the function with data received from the first external server 50 and with data received from the second external server 60. When executing a function and when executing a function using internal data of the display device 100, the function may be output in different forms.

Meanwhile, the display device 100 according to an embodiment of the present invention may transmit a data request signal to a different external server depending on the country in which it is set. Specifically, the display device 100 may have different external servers that provide services depending on the installation area. Accordingly, when the provider that provides data for executing the function is an external server, the control unit 170 may obtain the external server differently depending on the setting region of the display device 100. To this end, the display device 100 may further perform an operation of recognizing an external server by checking the setting country during operation according to the flowchart shown in FIG. 8.

Figure 9 is a flowchart showing a method of recognizing an external server according to the setting country according to an embodiment of the present invention. FIG. 9 may be added between steps S13 and S15 shown in FIG. 8, but is not limited thereto.

Referring to FIG. 9, the control unit 170 can obtain setting country information (S101).

Depending on the setting country, the provider providing data to run the function may be different. Accordingly, even if the voice command is the same, the control unit 170 may obtain different providers providing data for executing the function depending on the country in which it is set.

The control unit 170 can receive an input for setting the country and can set the country according to the input country information.

Meanwhile, the control unit 170 may receive an input for setting a language instead of a country. In Figure 9, a country is used as an example, but an external server can also be recognized depending on the language.

The control unit 170 can obtain a function provider according to the setting country (S103).

The storage unit 140 may store data mapping function providers for each of a plurality of countries. For example, the storage unit 140 is a function provider in a first country (e.g., Korea) is the display device 100 and a first external server, and the function provider in a second country (e.g., the United States) is the display device 100 and the first external server. It is the display device 100 and a second external server, and the function provider in the remaining country may store data mapping the display device 100.

The control unit 170 may obtain a function provider according to the setting country based on the data stored in the storage unit 140.

If the setting country is the first country (S105), the control unit 170 may recognize the function provider as the display device 100 and the first external server (S107).

If the set country is not the first country, the control unit 170 may determine whether the set country is the second country (S109). If the setting country is the second country, the control unit 170 may recognize the function provider as the display device 100 and the second external server (S109).

If the setting country is not the second country, the control unit 170 may recognize the display device 100 as the provider of the function (S113).

That is, if the setting country is a country in which the service cannot be provided through an external server, the control unit 170 recognizes the display device 100 as the provider of the function so that the display device 100 provides data for executing the function. You can.

When transmitting a data request signal to an external server in step S21 of FIG. 8, the control unit 170 may transmit the data request signal to the external server recognized in FIG. 9.

Meanwhile, in FIG. 9, the control unit 170 divides countries into the first country, the second country, and the remaining countries, but this is only an example for convenience of explanation and is not limited thereto.

Figure 10 is an example diagram of a voice command execution screen when the function provider according to an embodiment of the present invention is a display device, and Figure 11 is an example diagram of a voice command execution screen when the function provider according to an embodiment of the present invention is an external server. This is an example drawing.

The control unit 170 may receive a voice command while displaying the image 1000. The control unit 170 may display voice command information 1001 indicating the voice command received on the image 1000.

The control unit 170 may receive data for executing functions from at least one of the storage unit 140 and the wireless communication unit 173. The provider that provides data for executing the function may vary depending on the voice command information 1001.

For example, when the voice command information 1001 is content control information and TV control information, the display device 100 is a provider that provides data for executing the function, and the voice command information 1001 is content control information and TV control information. If it does not correspond to TV control information, an external server may be a provider that provides data to execute the function.

Examples of content control information and TV control information include ‘(Program name) Find a TV program’, ‘Show me (genre name) content’, ‘(Program name) Tell me the start time’, ‘Recommend something to watch’, ‘This program’ ‘Who is the director?’, ‘(Program name) Find director information’, ‘Play music’, ‘Tell me what I saw recently’, ‘(Function name) How to use’, ‘Volume up/down’’, ‘Channel up’ /Down', 'Record (program name)', 'Switch to set-top box', 'Brighten/dark screen brightness', 'Switch to movie mode', 'Previous/Close', 'Turn off TV', etc. You can.

The control unit 170 may control the display unit 180 to display the voice command execution screen differently depending on the provider who provided the data for executing the function.

Examples of voice command information 1001 that do not correspond to content control information and TV control information may include information search such as weather or time, data search such as schedule or photo, IoT function, etc., but these are examples. It's just an enemy.

As shown in FIG. 10 , the control unit 170 may display a voice command execution screen 1030 including a TV provision screen 1010 when the display device 100 is the provider of the function according to the voice command. That is, the voice command execution screen 1030 may include an image 1000 when receiving a voice command and a TV provided screen 1010, and the TV provided screen 1010 may be displayed on the video 1000. there is.

The TV provided screen 1010 may be a screen displayed when data for executing a function is received from the storage unit 140, and the data for displaying the TV provided screen 1010 is internal data of the display device 100. It can be provided by .

Meanwhile, as shown in FIG. 11, when the provider of the function according to the voice command is an external server, the control unit 170 may display a voice command execution screen 1030 including an external server provision screen 1020. That is, the voice command execution screen 1030 may include an image 1000 when receiving a voice command and an external server provided screen 1020, and the external server provided screen 1020 is displayed on the image 1000. It can be.

The external server provision screen 1020 may be a screen displayed when data for executing a function is received from the wireless communication unit 173, and the data for displaying the external server provision screen 1020 may be provided by an external server. You can.

Figure 12 is an example diagram of receiving account information through an account access screen according to an embodiment of the present invention, and Figure 13 is an example diagram of guiding account information through an account connection screen according to an embodiment of the present invention. am.

The control unit 170 may display a voice command execution screen 1030 including an account access screen 1040 if the provider providing data for executing the function is an external server and account access is required to execute the function. . The voice command execution screen 1030 may include an image 1000 that was being displayed when receiving the voice command and an account connection screen 1040, and the account connection screen 1040 may be displayed on the image 1000. .

Examples of cases where account information is required when executing a function according to a voice command may include a schedule search function registered in the account, a photo search function saved in the account, etc.

The account access screen 1040 may include account information. Account information is used to receive account information or guide account information on the account access screen (1040). Account information is provided among the sign-up icon (1041), account information input icon (1042), and previously saved account information (1045). It can contain at least one.

If there is no pre-stored account information, the control unit 170 may display an account access screen 1040 including a subscription icon 1041 and an account information input icon 1042 as shown in FIG. 12 .

The subscription icon 1041 may be an icon for subscribing to a site required to receive functions according to voice commands.

The account information input icon 1042 may be an icon for inputting account information to be used to execute a function according to a voice command. The account information input icon 1042 may be an icon for entering an ID and password.

When the control unit 170 receives an ID and password through the account information input icon 1042, the control unit 170 transmits account information corresponding to the received ID and password to an external server, and receives a function data signal corresponding to the account information from the external server. can do.

Meanwhile, if there is pre-stored account information in the storage unit 140, the control unit 170 may display the account access screen 1040 including the pre-stored account information 1045 as shown in FIG. 13.

The control unit 170 may execute a function according to the voice command using the previously stored account information 1045 displayed on the account access screen 1040 and display the voice command execution screen 1030.

If there is a plurality of account information pre-stored in the storage unit 140, the control unit 170 may display all of the plurality of account information on the account access screen 1040.

Additionally, the control unit 170 may further display another account access icon (not shown) for receiving other account information in addition to the pre-stored account information 1045 displayed on the account access screen 1040.

Meanwhile, the account access screen 1040 may further include a voice response icon 1043. The control unit 170 can turn on or off the voice response function by an external server whenever it receives a command to select the voice response icon 1043.

The user can turn on/off the function execution operation of the external server according to the voice command by turning the voice response function on/off through the voice response icon 1043.

Figure 14 is an example diagram of a method for displaying network connection information according to an embodiment of the present invention.

The control unit 170 may display network connection information 1051 when the provider providing data for executing the function is an external server and the data for executing the function cannot be received.

For example, as shown in FIG. 14, the control unit 170 may display a voice command execution screen 1030 including an image 1000 and an account connection screen 1050, and the account connection screen 1050 may include network connection information 1051.

That is, the control unit 170 may display network connection information 1051 on the account access screen 1050 when account information cannot be transmitted to an external server.

Meanwhile, the control unit 170 may display network connection information 1051 on an external server provision screen instead of the account connection screen 1050. For example, when the control unit 170 cannot transmit a data request signal to an external server or cannot receive a function data signal from an external server, the control unit 170 may display network connection information 1051 on the external server provided screen.

Figure 15 is an example diagram of a search result screen according to a voice command according to an embodiment of the present invention.

If data for executing a function is not obtained, the control unit 170 may display a voice command execution screen 1030 including a search result screen 1060 as shown in FIG. 15 . The voice command execution screen 1030 may include an image 1000 that was being displayed when receiving the voice command and a search result screen 1060, and the search result screen 1060 may be displayed on the image 1000. .

When the control unit 170 determines that the function according to the voice command information 1001 cannot be executed by the display device 100 and the external server 50 (60), the control unit 170 sends a voice command text according to the voice command information 1001. A search result screen 1060, which is the result of a search within the display device 100, can be displayed.

However, depending on the embodiment, the control unit 170 may display a search result screen in which a voice command text according to the voice command information 1001 is searched on at least one external server 50 or 60.

According to one embodiment of the present invention, the above-described method can be implemented as processor-readable code on a program-recorded medium. Examples of media that the processor can read include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made. It may be possible.

Claims (10)

storage unit;
a wireless communication unit communicating with at least one external server;
A voice recognition unit that receives voice commands;
Through a determination module that acquires a function corresponding to a voice command received through the voice recognition unit and determines whether the provider providing the function corresponding to the voice command is a display device or an external server, if the provider is internal, the function is provided. a control unit that receives data for execution from the storage unit and, if the provider determined through the determination module is an external server, requests and receives data for executing the function from the external server through the wireless communication unit; and
A display unit that displays a voice command execution screen differently depending on the provider providing the data for executing the above function.
Display device. According to paragraph 1,
The control unit
When data for executing the function is received from the storage unit, displaying a voice command execution screen including a TV provision screen on the display unit,
When data for executing the function is received from the wireless communication unit, a voice command execution screen including an external server provided screen is displayed on the display unit.
Display device. According to paragraph 1,
The control unit
The provider that provides the data for executing the above function is an external server, and if account access is required to execute the above function, a voice command execution screen including an account access screen is displayed.
Display device. According to paragraph 3,
The control unit
Displaying account information to receive or guide account information on the account access screen
Display device. According to paragraph 1,
The control unit
If data for executing the function cannot be received through the wireless communication unit, network connection information is displayed.
Display device. According to paragraph 1,
The control unit
If data for executing the function is not obtained, a search result screen for searching the voice command in the storage unit is displayed.
Display device. According to paragraph 1,
The control unit
Obtain a provider that provides data to execute the above functions depending on the country of setting,
Depending on the setting country, the external server that provides data for executing the above function may be different.
Display device. In clause 7,
The control unit
If the setting country is the first country, recognize the provider providing data for executing the function as the display device and the first external server,
If the setting country is a second country, recognize the provider providing data for executing the function as the display device and the second external server,
If the setting country is a country in which the service cannot be provided through an external server, the provider providing the above function is recognized as the display device.
Display device. According to paragraph 1,
The control unit
Executing an app provided by the external server when receiving a command to select a button provided on at least one of the display device and the remote control device for less than a standard time,
When receiving a command to select the button for more than the reference time, a voice recognition screen is displayed and a data request signal for executing a function according to the voice command is transmitted to the external server.
Display device. According to paragraph 1,
The control unit
Receiving the voice command through a first button or a second button provided on at least one of the display device and the remote control device,
When a voice command is received through the first button, the provider who provides data for executing the function is different from the provider who provides data for executing the function when a voice command is received through the second button.
Display device.

Images