KR20200102861A - Display device and operating method thereof - Google Patents

Abstract

The present invention provides a display device which more accurately provides a function in accordance with a voice command when receiving the voice command, and an operating method thereof. The display device may comprise: a storage unit; a wireless communication unit communicating with at least one external server; a voice recognition unit receiving a voice command; and a display unit differently displaying a voice command execution screen in accordance with a provider providing data for executing a control function obtaining a function corresponding to the voice command received through the voice recognition unit and receiving the data for executing the function from at least one of a storage unit and the wireless communication unit.

Description

A display device and its operation method TECHNICAL FIELD [DISPLAY DEVICE AND OPERATING METHOD THEREOF]

The present invention relates to a display device and a method of operating the same, and more particularly, to a display device that provides a function according to a voice command when receiving a voice command, and a method of operating the same.

In recent years, digital TV services using wired or wireless communication networks have become common. The digital TV service can provide a variety of services that could not be provided by conventional analog broadcasting services.

For example, in the case of IPTV (Internet Protocol Television) and smart TV services, which are one type of digital TV service, interactive features that enable users to actively select the type of viewing program and viewing time are provided. IPTV and smart TV services may provide various additional services, such as Internet search, home shopping, and online games, based on this interactive nature.

Recently, as artificial intelligence (AI) technology based on speech recognition is rapidly spreading, speech recognition technology is being applied to display devices. Accordingly, the display device can recognize the user's voice, and the user can more easily receive a desired service from the display device through a voice command.

Meanwhile, the service provided by the display device may include not only a service provided by the display device itself, but also a service provided from an external server. In this case, it is difficult for a user to know where and how a desired service is provided. Accordingly, when the display device receives a voice command even if the user does not specify the type of service, the service subject, etc., a method of more accurately providing a service according to the voice command may be required.

An object of the present invention is to provide a display device and a method of operating the same that more accurately provides a function according to a voice command when receiving a voice command.

An object of the present invention is to provide a display device capable of guiding a user of a function execution result according to a voice command and provider information of a function according to the voice command when receiving a voice command, and an operation method thereof.

An object of the present invention is to provide a display device capable of easily obtaining information necessary for executing a function according to a voice command from a user upon receiving a voice command and an operating method thereof.

A display device according to an embodiment of the present invention acquires a function corresponding to a voice command received through a storage unit, a wireless communication unit communicating with at least one external server, a voice recognition unit receiving a voice command, and a voice recognition unit, and It may include a display unit differently displaying a voice command execution screen according to a provider providing data for executing a control function that receives data for executing data from at least one of a storage unit and a wireless communication unit.

The control unit displays a voice command execution screen including a TV provision screen on the display unit when data for executing a function is received from the storage unit, and an external server on the display unit when data for executing the function is received from the wireless communication unit. A voice command execution screen including a provision screen may be displayed.

The controller may display a voice command execution screen including an account access screen when a provider providing data for executing a function is an external server, and when account access is required to execute the function.

The control unit may display account information for receiving or guiding account information on the account access screen.

The control unit may display network connection information when data for executing a function cannot be received through the wireless communication unit.

When data for executing a function is not obtained, the controller may display a search result screen of searching for a voice command from the storage unit.

The control unit acquires a provider that provides data for executing a function according to a set country, and a provider that provides data for executing a function may be different depending on the set country.

If the set country is a first country, the controller recognizes a provider providing data for executing the function as a display device and a first external server, and if the set country is a second country, the control unit displays a provider providing data for executing the function. It can be recognized as a device and a second external server.

The control unit executes an app provided by an external server when receiving a command to select a button provided in at least one of the display device and the remote control device for less than the reference time, and voice recognition when receiving a command to select the button for more than the reference time. After displaying the screen, a data request signal for executing a function according to a voice command can be transmitted to an external server.

The control unit receives a voice command through a first button or a second button provided in at least one of the display device and the remote control device, and provides data for executing a function when the voice command is received through the first button When a voice command is received through the and the second button, a provider providing data for executing a function may be different.

According to an embodiment of the present invention, when receiving a voice command, a function according to the voice command can be provided through various providers such as the display itself and an external server, and provider information can be guided to the user through different voice command execution screens. have.

According to an embodiment of the present invention, when receiving a voice command, by displaying or requesting information necessary to execute a function according to a voice command, there is an advantage that when a voice command is received, a function according to the voice command can be provided more quickly and accurately. .

According to an embodiment of the present invention, when a function according to a voice command requires account information, a function according to a user account can be provided through an account access screen.

According to an embodiment of the present invention, when a function according to a voice command must be provided from an external server, but data cannot be received from an external server, network connection information is displayed, thereby enabling a user to easily solve a problem.

1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention.
2 is a block diagram of a remote control device according to an embodiment of the present invention.
3 shows an example of an actual configuration of a remote control device according to an embodiment of the present invention.
4 illustrates an example of using a remote control device according to an embodiment of the present invention.
5 is a block diagram illustrating a method of executing a function corresponding to a voice command when a display device receives a voice command according to the first embodiment of the present invention.
6 is a block diagram illustrating a method of executing a function corresponding to a voice command when a display device receives a voice command according to a second embodiment of the present invention.
FIG. 7 is a block diagram illustrating a method of executing a function corresponding to a voice command when a display device receives a voice command according to a third embodiment of the present invention.
8 is a flowchart illustrating a method of providing a function according to a voice command when a display device receives a voice command according to an embodiment of the present invention.
9 is a flowchart illustrating a method of recognizing an external server according to a set country according to an embodiment of the present invention.
10 is an exemplary diagram of a voice command execution screen when a function provider according to an embodiment of the present invention is a display device.
11 is an exemplary diagram of a voice command execution screen when a function provider according to an embodiment of the present invention is an external server.
12 is an exemplary diagram of receiving account information through an account access screen according to an embodiment of the present invention.
13 is an exemplary diagram of guiding account information through an account access screen according to an embodiment of the present invention.
14 is an exemplary diagram of a method of displaying network connection information according to an embodiment of the present invention.
15 is an exemplary diagram of a search result screen according to a voice command according to an embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings.

A display device according to an embodiment of the present invention is, for example, an intelligent display device in which a computer support function is added to a broadcast reception function, and is faithful to a broadcast reception function and an Internet function is added, so that a handwriting input device, a touch screen Alternatively, a more convenient interface such as a space remote control can be provided. In addition, it is connected to the Internet and a computer with the support of a wired or wireless Internet function, and functions such as e-mail, web browsing, banking, or games can be performed. For these various functions, a standardized general-purpose OS can be used.

Accordingly, in the display device described in the present invention, since various applications can be freely added or deleted, for example, on a general-purpose OS kernel, various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and may be applied to a smartphone in some cases.

1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display device 100 includes a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , A display unit 180, an audio output unit 185, and a power supply unit 190 may be included.

The broadcast reception unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

The tuner 131 may select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a selected specific broadcast channel.

The demodulator 132 may divide the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and restore the separated video signal, audio signal, and data signal into a form capable of outputting.

The external device interface unit 135 may receive an application or an application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path with an external device. The external device interface unit 135 may receive one or more of an image and an audio output from an external device and transmit it to the control unit 170. An external device connectable to the external device interface unit 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater.

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

In addition, some content data stored in the display apparatus 100 may be transmitted to another user registered in advance in the display apparatus 100 or a selected user or a selected electronic device among other electronic devices.

The network interface unit 133 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received.

In addition, the network interface unit 133 may receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 may receive content such as movies, advertisements, games, VODs, broadcast signals, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 may receive update information and an update file of firmware provided by a network operator, and transmit data to the Internet or content provider or network operator.

The network interface unit 133 may select and receive a desired application from among applications open to the public through a network.

The storage unit 140 may store a program for processing and controlling each signal in the controller 170, and may store a signal-processed video, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 135 or the network interface unit 133. You can also store information about the image.

The storage unit 140 may store an application or an application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 may reproduce and provide a content file (movie file, still image file, music file, document file, application file, etc.) stored in the storage unit 140 to a user.

The user input interface unit 150 may transmit a signal input by the user to the controller 170 or may transmit a signal from the controller 170 to the user. For example, the user input interface unit 150 according to various communication methods such as Bluetooth, WB (Ultra Wideband), ZigBee method, RF (Radio Frequency) communication method, or infrared (IR) communication method, Control signals such as power on/off, channel selection, and screen setting may be received and processed from the remote control device 200, or a control signal from the control unit 170 may be transmitted to the remote control device 200.

In addition, the user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 170.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the corresponding image signal. Also, the image signal processed by the controller 170 may be input to an external output device through the external device interface unit 135.

The audio signal processed by the controller 170 may be audio output to the audio output unit 185. In addition, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the controller 170 may control the overall operation of the display apparatus 100.

In addition, the control unit 170 may control the display device 100 by a user command or an internal program input through the user input interface unit 150, and access the network to display an application or application list desired by the user. It can be downloaded within (100).

The control unit 170 enables channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

In addition, the control unit 170, in accordance with an external device image playback command received through the user input interface unit 150, from an external device input through the external device interface unit 135, for example, a camera or a camcorder, An image signal or an audio signal may be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 may control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131 or an external input input through the external device interface unit 135 An image, an image input through the network interface unit, or an image stored in the storage unit 140 may be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the control unit 170 may control content stored in the display device 100, received broadcast content, or external input content input from the outside to be played, and the content includes a broadcast image, an external input image, and an audio file. , Still images, connected web screens, and document files.

The wireless communication unit 173 may communicate with an external device through wired or wireless communication. The wireless communication unit 173 may perform short range communication with an external device. To this end, the wireless communication unit 173 includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi. Short-range communication may be supported by using at least one of (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. The wireless communication unit 173 is provided between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks in which the display device 100 or an external server is located may be supported. The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

Here, the other display device 100 is a wearable device capable of exchanging (or interlocking with) data with the display device 100 according to the present invention, for example, a smartwatch, a smart glass. (smart glass), HMD (head mounted display)), it can be a mobile terminal such as a smart phone. The wireless communication unit 173 may detect (or recognize) a wearable device capable of communicating around the display apparatus 100. Further, when the sensed wearable device is a device certified to communicate with the display apparatus 100 according to the present invention, the control unit 170 transmits at least part of the data processed by the display apparatus 100 to the wireless communication unit 173. It can be transmitted to the wearable device through. Accordingly, a user of the wearable device may use data processed by the display apparatus 100 through the wearable device.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170, or an image signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively. Can generate signals.

Meanwhile, since the display device 100 illustrated in FIG. 1 is only an embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted according to the specifications of the display device 100 that is actually implemented.

That is, if necessary, two or more components may be combined into a single component, or one component may be subdivided into two or more components and configured. In addition, the functions performed by each block are for explaining the embodiments of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

According to another embodiment of the present invention, the display apparatus 100 does not include a tuner 131 and a demodulation unit 132, but the network interface unit 133 or the external device interface unit ( 135) can also be received and played.

For example, the display device 100 is divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content reproducing device for reproducing content input from the image processing device. Can be implemented.

In this case, the operating method of the display device according to the embodiment of the present invention to be described below is not only the display device 100 as described with reference to FIG. 1, but also an image processing device or display unit such as the separated set-top box. 180) and the audio output unit 185 may be performed by any one of a content playback device.

Next, a remote control device according to an embodiment of the present invention will be described with reference to FIGS. 2 to 3.

2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 is a block diagram showing an example of an actual configuration of the remote control device according to an embodiment of the present invention.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 225 transmits and receives signals to and from any one of the display devices according to the exemplary embodiments described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard, and capable of transmitting and receiving signals with the display device 100 according to the IR communication standard. An IR module 223 may be provided. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals to and from the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 includes an NFC module 227 capable of transmitting and receiving signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and the display according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

On the other hand, the remote control device 200 may receive a signal transmitted from the display device 100 through the RF module 221, and power on/off the display device 100 through the IR module 223 as necessary. Commands for off, channel change, volume change, etc. can be transmitted.

The user input unit 230 may be composed of a keypad, a button, a touch pad, or a touch screen. A user may input a command related to the display device 100 to the remote control device 200 by manipulating the user input unit 230. When the user input unit 230 includes a hard key button, the user may input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be described with reference to FIG. 3.

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, A channel change button 237, a confirmation button 238, and a back button 239 may be included.

The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button 212 is capable of a push operation, and thus may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off power of the display apparatus 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the volume output by the display apparatus 100. The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

2 will be described again.

When the user input unit 230 includes a touch screen, the user may input a command related to the display device 100 to the remote control device 200 by touching a soft key on the touch screen. In addition, the user input unit 230 may include various types of input means that a user can manipulate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 can sense information on the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 is the moving speed of the remote control device 200 Information about the back can be sensed. On the other hand, the remote control device 200 may further include a distance measuring sensor, so that the distance to the display unit 180 of the display device 100 may be sensed.

The output unit 250 may output an image or audio signal corresponding to an operation of the user input unit 235 or a signal transmitted from the display apparatus 100. Through the output unit 250, the user can recognize whether the user input unit 235 is operated or whether the display device 100 is controlled.

For example, the output unit 250 includes an LED module 251 that lights up when a user input unit 235 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 225, a vibration module that generates vibration ( 253), a sound output module 255 for outputting sound, or a display module 257 for outputting an image may be provided.

In addition, the power supply unit 260 supplies power to the remote control device 200, and when the remote control device 200 has not moved for a predetermined period of time, power supply may be stopped, thereby reducing power waste. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control device 200. If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores information about a frequency band through which signals can be wirelessly transmitted and received with the display device 100 paired with the remote control device 200 in the storage unit 270 for reference. can do.

The controller 280 controls all matters related to the control of the remote control device 200. The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100).

In addition, the voice acquisition unit 290 of the remote control device 200 may acquire voice.

The voice acquisition unit 290 may include at least one microphone 291, and may acquire a voice through the microphone 291.

Next, FIG. 4 will be described.

4 shows an example of using a remote control device according to an embodiment of the present invention.

4A illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the drawing, since the corresponding pointer 205 is moved and displayed according to movement in the 3D space, the remote control device 200 may be referred to as a space remote controller.

4B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left in response thereto.

Information on the movement of the remote control device 200 detected through a sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case where a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. Accordingly, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner.

Conversely, when the user moves the remote control device 200 to be close to the display unit 180, a selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selection area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selection area may be zoomed in.

In addition, when a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state in which a specific button in the remote control device 200 is not pressed, only the pointer 205 is moved according to the up, down, left, and right movement of the remote control device 200.

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200.

Meanwhile, in this specification, a pointer refers to an object displayed on the display unit 180 in response to an operation of the remote control device 200. Accordingly, the pointer 205 can be used to make objects of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, and a thick outline. In addition, the pointer 205 may be displayed in correspondence with any one of a horizontal axis and a vertical axis on the display unit 180, as well as a plurality of points such as a line and a surface. Do.

When receiving a voice command, the display apparatus 100 according to an embodiment of the present invention may acquire data related to a function according to the voice command and display a screen for executing the voice command.

Meanwhile, when receiving a voice command, the display device may acquire data related to a function according to the voice command in various ways. Next, a method of acquiring data related to a function according to a voice command by the display device will be described with reference to FIGS. 5 to 7.

5 is a block diagram illustrating a configuration of a display device according to a first embodiment of the present invention for explaining a method of acquiring data related to a function according to a voice command when receiving a voice command.

According to the first embodiment of the present invention, the display apparatus 100 includes a voice recognition unit 171 for recognizing a voice command and a wireless communication unit 173 for transmitting and receiving signals with a provider providing a function corresponding to the voice command. ), a control unit 170 for executing a function corresponding to a voice command, and an output unit 186 for displaying the execution result of the function, and the output unit 186 is a display unit for visually outputting the execution result of the function ( 180) and an audio output unit 185 that aurally outputs the execution result of the function.

According to the first embodiment of the present invention, the display apparatus 100 may further include a determination module 10 that determines a provider providing a function corresponding to a voice command. However, each component illustrated in FIG. 5 shows only major components for convenience of description, and the display apparatus 100 may include more or fewer components than the components illustrated in FIG. 5.

Depending on the embodiment, the determination module 10 may be provided in the display device 100 or may be provided in the internal NLP server 15. According to the first embodiment of the present invention, the determination module 10 may be provided inside the display device 100, and according to the second to third embodiments of the present invention to be described later, the determination module 10 is It may be provided in the NLP server 15.

The determination module 10 is a component that determines a provider providing a function corresponding to a voice command, and the determination module 10 may determine a provider providing data related to a function corresponding to the voice command. . The determination module 10 may determine a provider who has provided data for executing a function according to a voice command.

The voice recognition unit 171 may include a voice input unit (not shown) such as a microphone to receive a user's voice command.

The voice input unit (not shown) may be provided as a separate component from the voice recognition unit 171. For example, the voice input unit (not shown) may be included in the user input interface unit 150 described in FIG. 1.

The voice recognition unit 171 may process a user's voice command input through a microphone as electrical voice data.

The voice recognition unit 171 may transmit the user's voice command to the internal STT server 13 upon receiving the user's voice command. The internal STT server 13 may convert voice data included in the voice command into text data in text format and transmit it to the voice recognition unit 171.

Here, the internal STT server 13 may mean a speech-to-text (STT) server that is connected to the display device 100 and converts a voice command received by the display device 100 into text data. In order to distinguish it from the STT server provided in the external server to be described later, it is only named as the internal STT server, so the name is not limited.

The internal STT server 13 and the internal NLP server 15 to be described later may be connected to the display device 100 through a network interface unit 133.

The voice recognition unit 171 may transmit a voice command converted to text data to the control unit 170, and the control unit 170 may obtain a function corresponding to the voice command by analyzing the voice command converted to text data. . That is, the control unit 170 may analyze what function the user inputs as a voice command.

Here, the function may refer to a service that can be provided by being executed on the display device 100, and includes not only essential services required for operation of the display device 100, but also ancillary services provided for the purpose of convenience and fun. can do. For example, functions may include channel/volume change, screen setting, content search, application-related services, gallery mode, Internet of Things (IOT) related services, and the like.

The determination module 10 may determine a provider that provides a function corresponding to the voice command.

The function may be a function provided by the display apparatus 100 itself, or a function provided by at least one or more external servers.

For example, a function provided by the display device 100 itself is a function that can be executed based on at least one of data received through the broadcast receiving unit 130 and internal data stored in the storage unit 140, and The provided function may be a function executable based on data received through the wireless communication unit 173.

The determination module 10 may determine whether a provider providing a function corresponding to the voice command is the display device 100, the first external server 50, or the second external server 60.

The determination module 10 may transmit a voice command converted into text data to the internal NLP server 15, and the internal NLP server 15 may receive a voice command in the form of text data from the determination module 10. The internal NLP server 15 may mechanically analyze a voice command in the form of text data to obtain a function intended by the text data. The internal NLP server 15 may transmit the acquired function to the determination module 10.

Similarly, here, the internal NLP server 15 may mean a Natural Language Server (NLP) server that is connected to the display device 100 and analyzes the user's intention according to the voice command input to the display device 100, which will be described later. In order to distinguish it from the NLP server provided in the external server, it is only named as the internal NLP server, so the name is not limited.

The internal NLP server 15 may analyze a voice command in the form of text data based on data stored in an already established natural language recognition processing database. For example, the internal NLP server 15 may obtain a function corresponding to the voice command by comparing text data according to the voice command with data built in the natural language recognition processing database and analyzing whether a matching letter exists. However, this is merely exemplary, and the internal NLP server 15 may acquire a function corresponding to a voice command in various ways.

The internal NLP server 15 transmits a function corresponding to the voice command to the determination module 10, and the determination module 10 may determine a provider of the function corresponding to the voice command.

According to an embodiment, the determination module 10 may store a table in which a plurality of functions and providers of each function are mapped, and may determine a provider corresponding to the acquired function based on the table.

According to another embodiment, the determination module 10 may store execution information of each function executed by the display apparatus 100 and obtain a provider of the function through the stored execution information. In addition, the determination module 10 may determine a provider of a function corresponding to the voice command in various ways.

Meanwhile, according to an embodiment, the internal NLP server 15 may acquire both a function corresponding to a voice command and a provider providing the function and transmit it to the determination module 10.

The internal NLP server 15 may transmit the function information corresponding to the voice command and the provider information to the determination module 10 as a single signal, or the function information corresponding to the voice command and the provider information as separate signals, respectively. It can also be transmitted.

The controller 170 may determine whether the provider of the acquired function is a specific external server or the display device 100.

When determining the function provider as the first external server 50, the control unit 170 transmits a data request signal to the first external server 50, and when determining the function provider as the second external server 60, the second A data request signal may be transmitted to the external server 60.

Here, the data request signal may be a signal requesting data for executing a function corresponding to a voice command.

The wireless communication unit 173 may transmit and receive data with at least one external server. For example, the wireless communication unit 173 may transmit and receive data to and from the first external server 50 and the second external server 60, but this is only exemplary. The wireless communication unit 173 may transmit and receive signals with two or more external servers.

The wireless communication unit 173 may transmit a data request signal for requesting data for executing a specific function to at least one external server, and may receive a function data signal in response to the data request signal.

Here, the function data signal may mean data related to a function according to the data request signal, and may include data used to execute a function according to the data request signal.

Upon receiving the data request signal, the first external server 50 or the second external server 60 may acquire data related to a function according to the data request signal and transmit the function data signal to the display apparatus 100. The data related to the function may mean data necessary for the execution of the function.

According to the first embodiment, the first external server 50 and the second external server 60 may not include an STT server and an NLP server. Accordingly, the wireless communication unit 173 transmits a data request signal including function information according to a voice command to any one of the external servers 50 and 60 based on the determination result of the determination module 10, and the external server ( 50) 60 may transmit data for executing a function included in the received data request signal to the wireless communication unit 173. That is, the external servers 50 and 60 may transmit the function data signal without analyzing the function according to the voice command.

The function data signal corresponding to the voice command may mean a signal including data related to the function corresponding to the voice command. That is, the external servers 50 and 60 may transmit data necessary for execution of a function corresponding to a voice command to the display apparatus 100 through a function data signal.

Meanwhile, if the controller 170 determines that the provider of the function is the display apparatus 100, the storage unit 140 may obtain data related to the function. Alternatively, when the provider of the function is the display device 100, the controller 170 may obtain data related to the function from at least one of the network interface unit 133 and the external device interface unit 135. Hereinafter, when the function provider is the display apparatus 100, the controller 170 will be described as acquiring data related to the function from the storage unit 140, but is not limited thereto for convenience of description.

In this case, the control unit 170 executes a function according to a voice command through data included in the function data signal received from the external server 50, 60, and the output unit 186 displays the execution result of the function. It may be output through at least one of 180 and the audio output unit 185.

That is, according to the first embodiment of the present invention, the controller 170 may obtain a function according to a voice command and a provider of a function according to the voice command through the determination module 10 provided therein. In addition, since the display device 100 has the determination module 10 inside, it does not communicate with a server that is not related to the function corresponding to the voice command, so it is necessary to send the data analyzed for the voice command to another server. Because there is no device, security can be reinforced, and the data transmission time is shortened and the line distance is shortened, thereby reducing traffic.

6 is a block diagram illustrating a method of executing a function corresponding to a voice command when a display device receives a voice command according to a second embodiment of the present invention.

6 shows a main configuration of a display device 100 according to a second embodiment of the present invention. The display device 100 includes a voice recognition unit 171, a wireless communication unit 173, an output unit 186, and It may include a control unit 170. In this case, the display apparatus 100 may be connected through the wireless communication unit 173 without having the determination module 10 therein, and the determination module 10 may be provided in the internal NLP server 15.

Since the same description as described in FIG. 5 is redundant, it will be omitted.

The wireless communication unit 173 may communicate with at least one external server 50 and 60, and the external server 50 and 60 may communicate with the internal NLP server 15.

The determination module 10 provided in the internal NLP server 15 determines the provider of the function corresponding to the voice command and transmits it to the external servers 50 and 60, and the external servers 50 and 60 are internal NLP servers. The provider information of the function received from 15 may be transmitted to the display apparatus 100.

According to the second embodiment of the present invention, the external server may include an STT server and an NLP server, respectively. That is, the first external server 50 includes a first STT server 53 and a first NLP server 55, and the second external server 60 is a second STT server 63 and a second NLP server ( 65) may be included. Since the external servers each have an STT server and an NLP server, the external server may determine a function corresponding to a voice command and a provider of the function.

Accordingly, the control unit 170 transmits the voice command to the first external server 50 and the second external server 60, and each of the first external server 50 and the second external server 60 responds to the voice command. You can acquire the ability to do

According to an embodiment, the controller 170 may directly transmit a voice command received through a voice input unit such as a microphone to the first external server 50 and the second external server 60. That is, the control unit 170 may transmit a voice command in the form of voice data to the first external server 50 and the second external server 60. In this case, the first external server 50 and the second external server 60 convert the voice command into text data through the STT server provided in each, and the NLP server analyzes the converted text data to respond to the voice command. You can acquire the ability to do.

According to another embodiment, the control unit 170 may transmit a voice command converted into text data form through the internal STT server 13 to the first external server 50 and the second external server 60. In this case, the first external server 50 and the second external server 60 may acquire a function of a voice command through an NLP server provided in each.

According to another embodiment, the controller 170 may transmit a voice command in the form of text data and a voice command in the form of voice data to the first external server 50 and the second external server 60 together. In this case, the first external server 50 and the second external server 60 convert the voice command into text data through the STT server provided in each, and convert the converted text data into text received from the display device 100. Can be compared to data. STT servers of the first external server 50 and the second external server 60 can reanalyze the voice command if the converted text data and the received text data are different from each other as a result of the comparison, thereby improving the analysis accuracy of the voice command. There is an advantage of being. Thereafter, the NLP servers of the first external server 50 and the second external server 60 may analyze the converted text data to obtain a function corresponding to the voice command.

The first external server 50 and the second external server 60 may each acquire a provider that provides the acquired function after acquiring a function corresponding to a voice command.

The first external server 50 and the second external server 60 each transmit information on the acquired function to the internal NLP server 15, and the internal NLP server 15 is a determination module 10 provided therein. It is possible to determine a provider that provides the obtained function through the. For example, the determination module 10 may determine that the provider of the function is one of the display device 100, the first external server 50, and the second external server 60.

After determining the provider of the function, the internal NLP server 15 may transmit information on the provider of the determined function to the first external server 50 and the second external server 60. In this way, the first external server 50 and the second external server 60 may obtain providers of functions corresponding to voice commands through the determination module 10 provided in the internal NLP server 15.

Meanwhile, according to an embodiment, the NLP servers 55 and 65 provided in the first external server 50 and the second external server 60 may include a determination module 10, and in this case, the first external server 50 The server 50 and the second external server 60 may determine a provider of the function.

The first external server 50 determines whether the provider of the acquired function is a first external server, and when the provider of the function is a first external server, acquires data related to a function corresponding to a voice command, and the display device 100 The function data signal corresponding to the voice command can be transmitted. Meanwhile, the first external server 50 may not perform any operation when the provider of the function is not the first external server.

In addition, according to another embodiment, when the provider of the function is not the first external server, the first external server 50 may transmit a message indicating that the provider of the function is not the first external server to the display device 100. . In this case, the display apparatus 100 may determine that the function corresponding to the voice command is not related to the first external server 50.

Similarly, the second external server 60 determines whether the provider of the acquired function is a second external server, and when the provider of the function is a second external server, acquires data related to the function corresponding to the voice command, and the display device ( 100), the function data signal corresponding to the voice command can be transmitted, and the second external server 60 does not perform any operation when the provider of the function is not a second external server, or the function provider is a second external server. A message indicating that it is not may be transmitted to the display device 100.

The controller 170 determines whether or not the function data signal has been received, and when receiving the function data signal, may execute a function corresponding to the voice command based on data related to the function included in the function data signal. Meanwhile, when the function data signal is not received, the control unit 170 may acquire data related to the function from the storage unit 140 and execute a function corresponding to the voice command.

FIG. 7 is a block diagram illustrating a method of executing a function corresponding to a voice command when a display device receives a voice command according to a third embodiment of the present invention.

7 is a diagram showing a main configuration of a display device 100 according to a third embodiment of the present invention. The display device 100 includes a voice recognition unit 171, a wireless communication unit 173, an output unit 186, and The control unit 170 may be included, and a keyword determination unit 17 may be further included. In this case, the determination module 10 may be provided in the internal NLP server 15 similar to that described with reference to FIG. 6.

The same description as that described in FIG. 5 or 6 is redundant, and thus will be omitted.

The voice recognition unit 171 may receive a voice command through a voice input unit such as a microphone, and transmit a voice command in the form of voice data to an internal STT server to convert it into text data form.

The keyword determination unit 17 may receive a voice command in the form of voice data or a voice command in the form of text data from the voice recognition unit 171.

The keyword determination unit 17 may recognize a preset keyword from the received voice command.

The control unit 170 may set keywords in advance. In this case, the control unit 170 may set different keywords for each provider that provides a function. The storage unit 140 may store different keywords set for each of the display device 100 and the external server.

The controller 170 may set different keywords for each of the first external server 50, the second external server 60, and the display device 100. The controller 170 may set a first keyword corresponding to the first external server 50, a second keyword corresponding to the second external server 60, and a third keyword corresponding to the display device 100, and , For example, the first keyword may be “Hey”, the second keyword may be “Execute”, and the third keyword may be “Hi, TV”, but this is only an example and there is no need to be limited thereto.

The control unit 170 may recognize a preset keyword from a voice command in the form of voice data or a voice command in the form of text data, and when a specific keyword is recognized, the provider corresponding to the recognized keyword is determined as a provider of the function according to the voice command. Then, data related to a function corresponding to a voice command may be received from a provider of the determined function.

That is, the controller 170 determines whether the provider of the function corresponding to the voice command is the first external server 50, the second external server 60, or the display device 100 based on the recognized keyword, and the function When the provider of is determined to be the first external server, a data request signal is transmitted to the first external server 50 to receive function-related data from the first external server 50, and the provider of the function corresponding to the voice command is provided. 2 If it is determined as an external server, a data request signal is transmitted to the second external server 60 to receive function-related data from the second external server 60, and a provider of a function corresponding to the voice command is the display device 100 If it is determined as, data related to a function corresponding to the voice command may be obtained from the storage unit 140.

Meanwhile, according to an exemplary embodiment, the display device 100 and the first external server 50 may check whether the first external server 50 is the provider of the function according to the data request signal. Specifically, the first external server 50 may reconfirm the provider of the function by receiving a determination result of the determination module 10 provided in the internal NLP server 15 through communication with the internal NLP server 15. That is, the first external server 50 may reconfirm the provider of the function by comparing whether the provider of the function determined through the keyword determination unit 17 matches the provider of the function determined through the determination module 10. The first external server 50 may transmit the reconfirmation result to the display apparatus 100, and the display apparatus 100 responds to the voice command only when the provider of the function is the first external server 50 based on the reconfirmation result. Data related to the corresponding function may be received from the first external server 50 and executed.

Likewise, according to an embodiment, the display apparatus 100 and the second external server 60 may check whether the second external server 60 is the provider of the function according to the data request signal. Specifically, the second external server 60 may receive a determination result of the determination module 10 provided in the internal NLP server 15 through communication with the internal NLP server 15 to reconfirm the provider of the function. That is, the second external server 60 may reconfirm the provider of the function by comparing whether the provider of the function determined through the keyword determination unit 17 matches the provider of the function determined through the determination module 10. The second external server 60 may transmit the reconfirmation result to the display apparatus 100, and the display apparatus 100 responds to the voice command only when the second external server 60 is the function provider based on the reconfirmation result. Data related to the corresponding function may be received from the second external server 60 and executed.

Meanwhile, in FIGS. 5 to 7, the external server is an example in which only the first external server 50 and the second external server 60 exist, and the display device 100 includes first and second external servers ( It is not limited to 50) (60), and it is possible to determine whether the function is provided for each of a plurality of external servers capable of communication.

8 is a flowchart illustrating a method of providing a function according to a voice command when a display device receives a voice command according to an embodiment of the present invention.

The control unit 170 may receive a voice command (S11).

The controller 170 may receive a user's voice command through the voice recognition unit 171.

Specifically, at least one of the display device 100 and the remote control device 200 linked to the display device 100 may include a voice input unit (not shown) that receives a voice command such as a microphone, and a voice recognition unit 171 may receive a voice command through a voice input unit (not shown).

The controller 170 may receive a voice command through a command for selecting a button provided on at least one of the display device 100 and the remote control device 200.

According to an embodiment, the display apparatus 100 and the remote control apparatus 200 may have one button for receiving a voice command.

For example, the control unit 170 may receive a voice command through a command for selecting a specific button provided on at least one of the display device 100 and the remote control device 200.

As another example, when receiving a command for selecting a specific button provided on at least one of the display device 100 and the remote control device 200 for less than a reference time, the controller 170 executes an app provided by an external server, and When a command for selecting a button for more than a reference time is received, a data request signal for executing a function according to the voice command may be transmitted from an external server after displaying a voice recognition screen. That is, in this case, the controller 170 may receive a voice command through a command for selecting a specific button capable of executing an app for more than a reference time.

According to another embodiment, the display apparatus 100 and the remote control apparatus 200 may have two or more buttons for receiving voice commands.

For example, the control unit 170 may receive a voice command through a first button or a second button provided on at least one of the display apparatus 100 and the remote control apparatus 200, and the control unit 170 When a voice command is received through the 1 button, a provider providing data for executing the function and a provider providing data for executing the function when a voice command is received through the second button may obtain differently. For example, when a voice command is received through a first button, the controller 170 transmits a data request signal for executing a function to a first external server, and when a voice command is received through a second button, the controller 170 performs the function. A data request signal for execution may be transmitted to the second external server.

As described above, according to an embodiment of the present invention, even if a voice command is received through at least one button without specifying the subject of execution of the function, data for executing the function through analysis of the voice command is transmitted to the display device or any one of them. Since it can be received from an external server, the user has the advantage of being able to easily receive a desired service without specifying the subject of execution of the function.

However, the method described above is merely an example for convenience of description, and the type of button, a method of selecting a button, the number of buttons, and the like may vary.

The controller 170 may acquire a function corresponding to the voice command and a provider of the function (S13).

The controller 170 may obtain a function and a provider of a function corresponding to the voice command received through the voice recognition unit 171. The control unit 170 may be obtained through a function and a provider of the function through at least one method described with reference to FIGS. 5 to 7. Since the method of acquiring the function has already been described with reference to FIGS. 5 to 7, redundant descriptions will be omitted.

The control unit 170 may acquire data for executing a function through at least one of the storage unit 140 and the wireless communication unit 173 according to a provider of the function.

The controller 170 may determine whether the function is a function that can be processed inside the display device (S13).

That is, the controller 170 may determine whether the function provider is the display device.

If the function is a function that can be processed inside the display device, the controller 170 may execute a function corresponding to the voice command based on the internal data (S17).

If the function is a function that can be processed inside the display device, the control unit 170 may obtain data for executing the function from the storage unit 140 and execute the function based on the data obtained from the storage unit 140. have.

Meanwhile, if the function does not correspond to a function that can be processed inside the display device, the control unit 170 may determine whether the function is a function that can be processed by the external servers 50 and 60 (S13).

The control unit 170 may obtain whether the function corresponds to a function that can be processed by the external servers 50 and 60.

However, the order of steps S15 and S19 may be changed.

If the function does not correspond to a function that can be processed by the external servers 50 and 60, the controller 170 may display a result of searching for a voice command from the display device 100 (S31).

When the function is a function that cannot be processed by either of the display device 100 and the external server 50 or 60, the controller 170 may display a result of searching for a voice command.

That is, when data for executing a function is not acquired, the control unit 170 may display a search result screen obtained by searching for a voice command from the storage unit 140.

For example, the controller 170 may display a search result screen including result information of a text corresponding to a voice command from at least one of the storage unit 140, a specific application, and the web.

In this case, even if the display device cannot execute a function according to a voice command, there is an advantage that it can provide a service requested by a user to the maximum.

If the function is a function that can be processed by the external servers 50 and 60, the controller 170 transmits a data request signal to the external servers 50 and 60 (S21), and transmits a function data signal corresponding to the data request signal. It can be received from the external server (50) (60) (S23).

That is, when the function is a function that can be processed by the external servers 50 and 60, the controller 170 may obtain data for executing the function from the external servers 50 and 60.

The control unit 170 determines whether account access is necessary (S25), and if account access is required, after receiving account information through the account access screen (S27), it can execute a function corresponding to the voice command based on the function data signal. Yes (S29). Meanwhile, if account access is not required, the controller 170 may immediately execute a function corresponding to the voice command based on the function data signal (S29).

The control unit 170 may determine whether account access is required to execute the function.

Specifically, when the external servers 50 and 60 require account information to execute a function, the account request signal is transmitted to the display device 100, and the control unit 170 is based on whether the account request signal is received. Thus, you can determine if you need to access your account.

If the function data signal is received without receiving the account request signal, the control unit 170 may determine that account access is not required, and execute the function based on data acquired through the function data signal.

When receiving the account request signal, the control unit 170 determines that account access is necessary, receives account information through the account access screen, transmits the received account information to the external servers 50, 60, and The function can be executed by receiving the function data signal.

According to an embodiment, when receiving an account request signal, the control unit 170 may obtain whether pre-stored account information exists. When there is no pre-stored account information, the control unit 170 may receive account information through an account access screen. When there is pre-stored account information, the control unit 170 may display an account access screen to check whether it is appropriate to execute a function through the stored account information. When there is pre-stored account information, the control unit 170 transmits pre-stored account information to the external servers 50 and 60 to receive a function data signal according to the account information and execute the function.

The controller 170 displays a voice command execution screen to be described later when a function corresponding to a voice command is executed based on internal data and a function corresponding to a voice command is executed based on a function data signal received from an external server. It can be displayed differently.

That is, the control unit 170 may output the function differently depending on the provider who provided the data related to the function. Specifically, even if the types of functions are the same, the control unit 170 may differently control the output types of functions according to providers. For example, even if the type of function is the same as'search', the control unit 170 executes the function with data received from the first external server 50 and the data received from the second external server 60. When a function is executed and when a function is executed with internal data of the display apparatus 100, the function may be output in a different form for each.

Meanwhile, the display apparatus 100 according to an exemplary embodiment of the present invention may transmit a data request signal to different external servers according to a set country. Specifically, the display apparatus 100 may have different external servers that provide services according to the installation area. Accordingly, when a provider providing data for executing a function is an external server, the control unit 170 may acquire the external server differently according to a set area of the display apparatus 100. To this end, the display apparatus 100 may further perform an operation of recognizing an external server by checking a set country during operation according to the flow chart illustrated in FIG. 8.

9 is a flowchart illustrating a method of recognizing an external server according to a set country according to an embodiment of the present invention. FIG. 9 may be added between steps S13 and S15 shown in FIG. 8, but is not limited thereto.

Referring to FIG. 9, the control unit 170 may obtain set country information (S101).

Depending on the country of setting, the providers that provide data for executing the function may differ. Accordingly, even if the voice command is the same, the controller 170 may obtain different providers that provide data for executing functions according to the set country.

The controller 170 may receive an input for setting a country, and may set a country according to the input country information.

Meanwhile, the controller 170 may receive an input for setting a language instead of a country. In FIG. 9, the country is illustrated as an example, but an external server may be recognized according to a language.

The control unit 170 may acquire a provider of a function according to the set country (S103).

The storage unit 140 may store data obtained by mapping function providers for each of a plurality of countries. For example, in the storage unit 140, a function provider of a first country (eg, Korea) is a display device 100 and a first external server, and a function provider of a second country (eg, United States) is The display apparatus 100 and the second external server, and function providers in other countries may store data mapped to the display apparatus 100.

The control unit 170 may acquire a provider of a function according to a set country based on data stored in the storage unit 140.

If the set country is the first country (S105), the controller 170 may recognize the provider of the function as the display apparatus 100 and the first external server (S107).

If the set country is not the first country, the control unit 170 may determine whether the set country is the second country (S109). If the setting country is the second country, the controller 170 may recognize the provider of the function as the display apparatus 100 and a second external server (S109).

When the setting country is not the second country, the control unit 170 may recognize the provider of the function as the display apparatus 100 (S113).

That is, when the setting country is a country in which a service cannot be provided through an external server, the controller 170 recognizes a competent provider as the display device 100 so that the display device 100 provides data for executing the function. I can.

When transmitting the data request signal to the external server in step S21 of FIG. 8, the controller 170 may transmit the data request signal to the external server recognized in FIG. 9.

Meanwhile, in FIG. 9, the control unit 170 divides the country into a first country, a second country, and the rest of the countries, but this is only an example for convenience of description, and thus is not limited thereto.

10 is an exemplary diagram of a voice command execution screen when a function provider according to an embodiment of the present invention is a display device, and FIG. 11 is a view showing a voice command execution screen when a function provider according to an embodiment of the present invention is an external server. It is an example drawing.

The controller 170 may receive a voice command while the image 1000 is being displayed. The controller 170 may display voice command information 1001 indicating a voice command received on the image 1000.

The control unit 170 may receive data for executing a function from at least one of the storage unit 140 and the wireless communication unit 173. A provider that provides data for executing the function may vary according to the voice command information 1001.

For example, if the voice command information 1001 is content control information and TV control information, the display device 100 is a provider that provides data for executing a function, and the voice command information 1001 is the content control information and If it does not correspond to the TV control information, the external server may be a provider that provides data for executing a function.

Examples of content control information and TV control information are'(program name) find TV program','(genre name) show contents','(program name) start time','recommend something to watch','this program ','(Program name) find direction information','Play music','Tell me what I saw recently','(Function name) how to use','Volume up/down',''Channel up' Includes'/down','(program name) record','switch to set-top box','bright/dark screen','change to movie mode','previous/close','turn off TV', etc. I can.

The controller 170 may control the display 180 to display a voice command execution screen differently according to a provider providing data for executing a function.

Examples of the voice command information 1001 that do not correspond to the content control information and the TV control information may include information search such as weather or time, data search such as schedule or photos, IoT function, etc. It's just an enemy.

As illustrated in FIG. 10, when the display apparatus 100 provides a function according to a voice command, the controller 170 may display a voice command execution screen 1030 including a TV providing screen 1010. That is, the voice command execution screen 1030 may include an image 1000 and a TV provision screen 1010 when a voice command is received, and the TV provision screen 1010 may be displayed on the image 1000. have.

The TV providing screen 1010 may be a screen displayed when data for executing a function is received from the storage unit 140, and the data for displaying the TV providing screen 1010 is internal data of the display device 100 Can be provided by

Meanwhile, as shown in FIG. 11, when the provider of the function according to the voice command is an external server, the control unit 170 may display a voice command execution screen 1030 including an external server providing screen 1020. That is, the voice command execution screen 1030 may include an image 1000 when receiving a voice command and an external server providing screen 1020, and the external server providing screen 1020 is displayed on the image 1000. Can be.

The external server providing screen 1020 may be a screen displayed when data for executing a function is received from the wireless communication unit 173, and data for displaying the external server providing screen 1020 may be provided by an external server. I can.

12 is an exemplary diagram of receiving account information through an account access screen according to an embodiment of the present invention, and FIG. 13 is an exemplary diagram of guiding account information through an account access screen according to an embodiment of the present invention to be.

The controller 170 may display a voice command execution screen 1030 including an account access screen 1040 when a provider providing data for executing a function is an external server, and when account access is required to execute the function. . The voice command execution screen 1030 may include an image 1000 and an account access screen 1040 being displayed when the voice command is received, and the account access screen 1040 may be displayed on the image 1000. .

An example of a case where account information is required when a function according to a voice command is executed may include a schedule search function registered in an account, a picture search function stored in the account, and the like.

The account access screen 1040 may include account information. The account information is to receive account information on the account access screen 1040 or to guide the account information, and the account information is among the subscription icon 1041, the account information input icon 1042, and the previously stored account information 1045. It may include at least one.

When there is no pre-stored account information, the controller 170 may display an account access screen 1040 including a subscription icon 1041 and an account information input icon 1042 as shown in FIG. 12.

The subscription icon 1041 may be an icon for signing up for a site required to receive a function according to a voice command.

The account information input icon 1042 may be an icon for receiving account information to be used to execute a function according to a voice command. The account information input icon 1042 may be an icon for receiving an ID and a password.

When receiving the ID and password through the account information input icon 1042, the control unit 170 transmits the account information corresponding to the received ID and password to an external server, and receives a function data signal corresponding to the account information from the external server. can do.

Meanwhile, when there is pre-stored account information in the storage unit 140, the control unit 170 may display an account access screen 1040 including pre-stored account information 1045 as shown in FIG. 13.

The controller 170 may display a voice command execution screen 1030 by executing a function according to a voice command using the previously stored account information 1045 displayed on the account access screen 1040.

When there are a plurality of account information previously stored in the storage unit 140, the control unit 170 may display all of the plurality of account information on the account access screen 1040.

In addition, the controller 170 may further display another account access icon (not shown) for receiving other account information in addition to the previously stored account information 1045 displayed on the account access screen 1040.

Meanwhile, the account access screen 1040 may further include a voice response icon 1043. The control unit 170 may turn on or off a voice response function by an external server whenever a command for selecting the voice response icon 1043 is received.

The user may turn on/off the voice response function through the voice response icon 1043 to set on/off of the function execution operation of the external server according to the voice command.

14 is an exemplary diagram of a method of displaying network connection information according to an embodiment of the present invention.

The controller 170 may display the network connection information 1051 when a provider providing data for executing a function is an external server and cannot receive data for executing a function.

For example, as shown in FIG. 14, the controller 170 may display a voice command execution screen 1030 including an image 1000 and an account access screen 1050, and the account access screen 1050 May include network connection information 1051.

That is, when the account information cannot be transmitted to an external server, the controller 170 may display the network connection information 1051 on the account access screen 1050.

Meanwhile, the controller 170 may display the network connection information 1051 on an external server providing screen instead of the account access screen 1050. For example, when the controller 170 cannot transmit a data request signal to an external server or cannot receive a function data signal from an external server, the controller 170 may display the network connection information 1051 on the external server providing screen.

15 is an exemplary diagram of a search result screen according to a voice command according to an embodiment of the present invention.

When data for executing a function is not obtained, the controller 170 may display a voice command execution screen 1030 including a search result screen 1060 as illustrated in FIG. 15. The voice command execution screen 1030 may include an image 1000 and a search result screen 1060 being displayed when receiving a voice command, and the search result screen 1060 may be displayed on the image 1000. .

When it is determined that the function according to the voice command information 1001 cannot be executed by the display device 100 and the external servers 50, 60, the control unit 170 transmits a voice command text according to the voice command information 1001. A search result screen 1060 that is a result of searching inside the display apparatus 100 may be displayed.

However, according to an embodiment, the control unit 170 may display a search result screen obtained by searching for a voice command text according to the voice command information 1001 from at least one external server 50 or 60.

According to an embodiment of the present invention, the above-described method can be implemented as code that can be read by a processor in a medium on which a program is recorded. Examples of media readable by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

The display device described above is not limited to the configuration and method of the above-described embodiments, but the embodiments are configured by selectively combining all or part of each of the embodiments so that various modifications can be made. May be.

Claims (10)

Storage;
A wireless communication unit communicating with at least one external server;
A voice recognition unit for receiving a voice command;
A control unit for acquiring a function corresponding to the voice command received through the speech recognition unit and receiving data for executing the function from at least one of the storage unit and the wireless communication unit; And
Including a display unit for differently displaying a voice command execution screen according to a provider providing data for executing the function
Display device. The method of claim 1,
The control unit
When data for executing the function is received from the storage unit, a voice command execution screen including a TV provision screen is displayed on the display unit,
When data for executing the function is received from the wireless communication unit, displaying a voice command execution screen including an external server providing screen on the display unit
Display device. The method of claim 1,
The control unit
When the provider that provides data for executing the function is an external server, and when account access is required to execute the function, a voice command execution screen including an account access screen is displayed.
Display device. The method of claim 3,
The control unit
Displaying account information for receiving or guiding account information on the account access screen
Display device. The method of claim 1,
The control unit
Displaying network connection information when data for executing the function cannot be received through the wireless communication unit
Display device. The method of claim 1,
The control unit
When data for executing the function is not obtained, displaying a search result screen of searching for the voice command in the storage unit
Display device. The method of claim 1,
The control unit
Obtaining a provider that provides data for executing the function according to the set country,
Providers that provide data for executing the function are different according to the set country.
Display device. The method of claim 7,
The control unit
If the set country is a first country, a provider providing data for executing the function is recognized as a display device and a first external server,
If the set country is a second country, a provider that provides data for executing the function is recognized as the display device and a second external server.
Display device. The method of claim 1,
The control unit
When a command for selecting a button provided in at least one of the display device and the remote control device for less than a reference time is received, an app provided by the external server is executed,
When a command for selecting the button for more than the reference time is received, a voice recognition screen is displayed and a data request signal for executing a function according to the voice command is transmitted to the external server.
Display device. The method of claim 1,
The control unit
Receiving the voice command through a first button or a second button provided in at least one of the display device and the remote control device,
When a voice command is received through the first button, a provider providing data for executing the function is different from a provider providing data for executing the function when a voice command is received through the second button.
Display device.

Images