KR102334860B1 - Display apparatus and the control method thereof - Google Patents

Abstract

A display device is disclosed. The device includes a display unit, a user input interface unit that receives a user voice signal and a cursor signal from a remote control in voice recognition mode, respectively, and displays text corresponding to the received user voice signal on the display unit, and uses the cursor signal to and a control unit that executes an operation according to the voice signal.

Description

Display device and its control method

The present invention relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus and a control method thereof for recognizing a user's voice and performing an operation according thereto.

The display device refers to a device that displays an image transmitted from a broadcasting station or the like through a display unit such as a CRT, PDP, LCD, or OLED. Recently, display devices have been developed from traditional analog TVs to DTVs (Digital TVs) capable of outputting high-definition images and high-quality sound, and in addition, they have developed rapidly into Internet Protocol TVs (IPTVs) that can connect to the Internet. have.

In addition to the digital broadcast reception function, recent display devices provide various functions such as an electronic program guide (EPG) reception function, a two-way communication function, and an Internet connection function. In addition, it is possible to take charge of server functions in a home network environment or a ubiquitous environment.

On the other hand, IPTV is distinguished from existing TV in that it is possible to select and view or edit a desired broadcast. In other words, IPTV has various advantages in that it can not only watch programs aired by broadcasting stations through the Internet like conventional TVs, but also receive various contents provided on the Internet without the need to separately operate a PC. Because of these advantages, it is expected that IPTV capable of bidirectional communication will receive more attention.

Therefore, future display devices need to provide more diverse and convenient functions, out of the conventional simple content display function.

SUMMARY OF THE INVENTION The present invention has been made in accordance with the above-described necessity, and an object of the present invention is to provide a display device and a control method thereof that allow intuitive operation by recognizing a remote control signal simultaneously with voice recognition.

In order to achieve the above object, a display device according to an embodiment of the present invention includes a display unit, a user input interface unit for receiving a user voice signal and a cursor signal from a remote control in a voice recognition mode, respectively, and a user voice signal to the received user voice signal. and a control unit that displays the corresponding text on the display unit and executes an operation according to the user's voice signal using the cursor signal.

Also, in the voice recognition mode, the controller may simultaneously receive a user voice signal and a cursor signal.

Also, the controller may form a content area in which content is displayed, a query area in which text is displayed, and a list area in which a search result corresponding to the displayed text is displayed on the display unit.

In addition, the controller may provide a preset visual effect to one of the content lists displayed in the list area at which the cursor is positioned.

In addition, the controller may automatically display information on one of the content lists displayed on the list area on which the cursor is positioned on either the content area or the list area.

Also, when a preset user voice signal is received while the cursor is positioned on any one of the content lists displayed in the list area, the controller may delete one content on which the cursor is positioned from the content list.

Also, when a preset control signal is received through the user input interface unit while the cursor is positioned on any one of the content lists displayed in the list area, the controller may delete one content on which the cursor is positioned from the content list.

Also, when a preset user voice signal is received while the cursor is positioned on any one of the content lists displayed in the list area, the controller may execute one content on which the cursor is positioned.

Also, when a preset control signal is received through the user input interface unit while the cursor is positioned on any one of the content lists displayed in the list area, the controller may execute one content on which the cursor is positioned.

Also, the controller may select at least a part of the displayed text by using the remote controller.

Also, the controller may select a part of the displayed text by a drag operation through the remote control.

Also, the controller may replace the selected text with a text corresponding to the received user voice signal.

Also, the controller may display a search result corresponding to the substituted text in the list area.

In addition, the controller may select an image displayed on the content area as a cursor, and when a preset user voice signal is received, the controller may execute an operation corresponding to the received user voice signal with respect to the selected image.

Also, the image is a text image, and the controller may execute an operation corresponding to the received user voice signal with respect to the text in which the text image is converted.

Also, when a preset user voice signal is received while the cursor is positioned on one object displayed on the display unit, the controller may execute an operation corresponding to the received user voice signal with respect to one object on which the cursor is positioned.

Also, the controller may provide a preset visual effect to one object.

Also, when a preset user voice signal is received while the cursor is positioned on one side of the screen displayed on the display unit, the controller may change the entire screen based on the position of the cursor in response to the received user voice signal.

On the other hand, the control method of the display apparatus according to an embodiment of the present invention comprises receiving, respectively, a signal corresponding to a user voice signal and a cursor signal from a remote control in a voice recognition mode, and displaying text corresponding to the received user voice signal on the display unit and performing an operation according to the user's voice signal using the cursor signal.

According to at least one of the embodiments of the present invention, since an operation according to the remote control signal as well as the user's voice is executed in the voice recognition mode, user convenience can be improved and various functions can be provided.

Further scope of applicability of the present invention will become apparent from the following detailed description. However, it should be understood that the detailed description and specific embodiments such as the preferred embodiments of the present invention are given by way of illustration only, since various changes and modifications within the spirit and scope of the present invention may be clearly understood by those skilled in the art.

1 is an example of a diagram for explaining communication between a display device and an external device according to an embodiment of the present invention;
2 is an example of a block diagram of a broadcast transmission apparatus according to an embodiment of the present invention;
3 is an example of a block diagram of a display device according to an embodiment of the present invention;
4 is various examples of drawings for explaining a method of controlling a wireless input unit according to an embodiment of the present invention;
5 is an example of a block diagram of a wireless input unit according to an embodiment of the present invention;
6 is an example of a diagram related to the operation of a display device according to the prior art;
7 is an example of a flowchart related to a method for controlling a display device according to an embodiment of the present invention;
8 to 16 are various examples of drawings for explaining the operation of the display device according to an embodiment of the present invention;
17 is an example of a flowchart related to a method for controlling a display device according to another embodiment of the present invention;
18 to 25 are various examples of drawings for explaining an operation of a display apparatus according to another embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, and includes one or more other features or It should be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof does not preclude the possibility of addition.

The display device described herein may include an analog TV, a DTV, an IPTV, a Smart TV, a 3D TV, a projection TV, and other various monitors, as well as a desktop computer, a digital signage, and the like.

However, the configuration according to the embodiment described in this specification is a mobile phone, a smart phone (smart phone), a laptop computer (laptop computer), digital broadcasting terminal, PDA (personal digital assistants), PMP (portable multimedia), except for cases applicable only to TV. player), navigation, slate PC, tablet PC, ultrabook, wearable device, for example, watch-type terminal (smartwatch), glass-type terminal (smart glass), Those skilled in the art will readily appreciate that it may also be applied to a mobile terminal such as a head mounted display (HMD).

1 is a diagram for explaining a process in which a display apparatus 100 according to the present invention communicates with an external device.

As shown in FIG. 1 , the display apparatus 100 according to an embodiment of the present invention may communicate with a broadcasting station 10 , a network server 20 , or an external device 30 . Also, although not shown in FIG. 1 , a remote controller (not shown) for controlling the display apparatus 100 may be further included.

On the other hand, it is clearly stated that the display device 100 disclosed in this document is not limited to the TV. That is, the display device 100 may be a set-top box (STB), an Internet Protocol TV (IPTV), a personal computer, etc., except when the configuration according to the embodiment described in this specification is applicable only to the TV. have.

The display device 100 may receive a broadcast signal including an image signal transmitted from the broadcast station 10 . The display apparatus 100 may process an image signal, an audio signal, or a data signal included in the broadcast signal to be suitable for output from the display apparatus 100 . The display apparatus 100 may output an image or audio based on the processed image signal.

Meanwhile, the display apparatus 100 may communicate with the network server 20 . The network server 20 is a device capable of transmitting and receiving signals to and from the display device 100 through an arbitrary network. For example, the network server 20 may be a mobile phone terminal that can be connected to the display apparatus 100 through a wired or wireless base station. Also, the network server 20 may be a device capable of providing content to the display device 100 through an Internet network. The content provider may provide content to the display apparatus 100 using a network server. Also, the network server 20 may be a device capable of providing various web services and other information to the display device 100 through an Internet network.

Meanwhile, the display device 100 may communicate with the external device 30 . The external device 30 is a device capable of directly transmitting and receiving signals to and from the display device 100 by wire or wirelessly. For example, the external device 30 may be a media storage device or a playback device used by the user. That is, the external device 30 may correspond to a camera, a DVD player, a Blu-ray player, a personal computer, and the like.

The broadcasting station 10 , the network server 20 , or the external device 30 may transmit a signal including an image signal to the display device 100 . The display apparatus 100 may display an image based on an image signal included in an input signal. Also, the display apparatus 100 may transmit a signal transmitted from the broadcasting station 10 or the network server 20 to the display apparatus 100 to the external apparatus 30 . Also, a signal transmitted from the external device 30 to the display device 100 may be transmitted to the broadcasting station 10 or the network server 20 . That is, the display device 100 has a function of directly playing back content included in signals transmitted from the broadcasting station 10 , the network server 20 and the external device 30 on the display device 100 , as well as a function of delivering it. include

2 is a block diagram of a broadcast transmission apparatus 50 according to an embodiment of the present invention. FIG. 2 illustrates a broadcast transmission device 50 included in the broadcast station 10 shown in FIG. 1 as an example.

The broadcast transmission device 50 according to an embodiment of the present invention may include a broadcast content storage unit 51 , a GUI information generation unit 52 , a broadcast data conversion unit 53 , and a transmission unit 54 . have.

The broadcast content storage unit 51 stores at least one broadcast content to be transmitted to the display apparatus 100 . The broadcast content storage unit 51 may receive and store externally generated broadcast content, or may generate and store broadcast content to be transmitted. The broadcast content may include at least one of video, audio, and data. In general, video broadcasting, audio broadcasting, and data broadcasting are called according to the type of broadcasting content. If broadcast content is expressed differently, it can be called multimedia content.

The GUI information generator 51 may generate at least one piece of GUI information to be transmitted to the display apparatus 100 and store it. The GUI information may include at least one of image information, color information, menu information, text information, and screen configuration information.

The image information is information about various images to be used in the GUI. The image may include at least one of a still image, a moving picture, a flash, and an animation. The color information is information on image characteristics including various colors, brightness, and saturation to be used in the GUI. The menu information is information about the type or configuration of a menu to be displayed on the GUI. The text information is information about the color, font, size, etc. of text to be used in the GUI. The screen configuration information is information on the configuration of images, menus, and texts to be used in the GUI.

The GUI information stored in the GUI information generating unit 52 may include unique GUI information of the broadcasting station 10 . For example, the GUI information may include a logo representing the broadcasting station 10 or a specific channel provided by the broadcasting station 10 . The logo may include an image. Also, the GUI information may include unique GUI information corresponding to specific broadcast content generated by the broadcasting station 10 .

Meanwhile, the GUI information may include at least one of a graphic element and the audio element. In addition, the GUI information may include location information indicating a path of a place in which at least one of a graphic element and an audio element is stored. For example, at least one of a graphic element and an audio element is stored in a web server operated by the broadcasting station 10 , and the GUI information stored in the GUI information generating unit 52 is a graphic element or an audio element is a web server It may include location information indicating a path stored in the . For example, the location information may include a uniform resource locator (URL) address or a uniform resource identifier (URI).

When the display apparatus 100 receives GUI information including location information, a graphic element or an audio element may be downloaded with reference to the location information.

The broadcast data converter 53 may convert the broadcast content stored in the broadcast content storage 51 and GUI information output by the GUI information generator 52 into a transmittable broadcast data format and output the converted broadcast data. In addition, the generated broadcast signal may be packetized and output according to a broadcast signal transmission principle or broadcast standard.

The transmission unit 54 may transmit the broadcast signal generated by the broadcast data conversion unit 53 through a transmission network.

3 is a view for explaining the configuration of the display apparatus 100 according to the present invention. Hereinafter, descriptions of parts overlapping with the above description will be omitted.

Referring to FIG. 3 , the display apparatus 100 according to an embodiment of the present invention includes a display unit 171 that displays an image and a driving unit that supplies a driving signal to the display unit 171 in response to a received broadcast signal ( 170) may be included.

The display unit 171 may be referred to as a display panel.

The driving unit 170 may control image display and audio output of the display apparatus 100 . The driving unit 170 may include a receiving unit 110 , an external device interface unit 130 , a storage unit 120 , a user input interface unit 140 , a control unit 160 , and a command input unit 150 .

The driving unit 170 and the display unit 171 may be integrally formed. Alternatively, the driving unit 170 and the display unit 171 may be separately modularized, and it may be possible to communicate by wire or wirelessly.

In addition, the display apparatus 100 according to the present invention includes a sound output unit 172 for outputting sound, a sound sensing unit 173 for sensing sound, and a motion sensing unit for sensing a user's movement ( 174) may be included.

The display apparatus 100 according to the present invention will be described in more detail as follows.

The receiver 110 may include a tuner 111 , a demodulator 112 , and a network interface unit 113 . If necessary, it is also possible to design the tuner 111 and the demodulator 112 while not including the network interface unit 113. Conversely, while the network interface unit 113 is provided, the tuner 111 and the demodulator ( 112) is also possible to design not to include.

The tuner 111 may select an RF broadcast signal corresponding to a channel selected by a user or all channels stored in advance among radio frequency (RF) broadcast signals received through an antenna. In addition, the selected RF broadcast signal is converted into an intermediate frequency signal or a baseband video or audio signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it may be converted into a digital IF signal (DIF), and if the selected RF broadcast signal is an analog broadcast signal, it may be converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner 111 may process both a digital broadcast signal and an analog broadcast signal. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 111 may be directly input to the controller 160 .

The demodulator 112 may receive the digital IF signal DIF converted by the tuner 111 and perform a demodulation operation.

For example, when the digital IF signal output from the tuner 111 is ATSC, the demodulator 112 may perform, for example, 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulator 112 may perform channel decoding. To this end, the demodulator 112 includes a trellis decoder, a de-interleaver, a Reed Solomon decoder, and the like, so as to perform trellis decoding, deinterleaving, and Reed Solomon Decoder. Decryption can be performed.

For example, when the digital IF signal output from the tuner 111 is a DVB method, the demodulator 112 may perform coded orthogonal frequency division modulation (COFDMA) demodulation, for example. Also, the demodulator 112 may perform channel decoding. To this end, the demodulator 112 may include a convolution decoder, a deinterleaver, a Reed-Soloman decoder, and the like to perform convolutional decoding, deinterleaving, and Reed-Soloman decoding.

The demodulator 112 may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be an image signal, an audio signal, or a multiplexed data signal. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 audio signal, and the like are multiplexed. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The stream signal output from the demodulator 112 may be input to the controller 160 .

After performing demultiplexing and image/audio signal processing, the controller 160 may output an image to the display unit 171 and output an audio to the sound output unit 172 .

The external device interface unit 130 may connect an external device and the display device 100 according to the present invention. To this end, the external device interface unit 130 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray, game device, camcorder, computer (laptop), and the like by wire/wireless. The external device interface unit 135 may transmit an image, audio, or data signal input from the outside through a connected external device to the controller 160 of the display device 100 . Also, the image, audio, or data signal processed by the controller 160 may be output to a connected external device. To this end, the external device interface unit 130 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The network interface unit 113 may provide an interface for connecting the display apparatus 100 to a wired/wireless network including an Internet network. The network interface unit 113 may include, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi-Fi). ), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. may be used.

The network interface unit 113 may transmit or receive data with other users or other electronic devices through the connected network or another network linked to the connected network.

Meanwhile, the network interface unit 113 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server. In addition, content or data provided by a content provider or network operator may be received. That is, it is possible to receive content such as a movie, advertisement, game, VOD, and broadcast signal and information related thereto from a content provider or a network provider through a network. In addition, it is possible to receive firmware update information and update files provided by the network operator. It may also transmit data to the Internet or to a content provider or network operator.

The storage unit 120 may store a program for each signal processing and control in the control unit 160, and may store a signal-processed image, audio, or data signal.

Also, the storage unit 120 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 130 or the network interface unit 113 . In addition, the storage unit 120 may store information about a predetermined broadcast channel through a channel storage function.

The storage unit 120 may include, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg, SD or XD memory). etc.), RAM, and ROM (EEPROM, etc.) may include at least one type of storage medium.

The display apparatus 100 may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the storage unit 120 and provide them to the user.

3 illustrates a case in which the storage unit 120 is provided separately from the control unit 160 , the storage unit 120 may be included in the control unit 160 .

The command input unit 150 may include an input key for a user to input a command. The command input unit 150 may include a wired input unit 151 for inputting commands by wire and a wireless input unit 200 for wirelessly inputting commands.

The command input unit 150 can input various commands such as power on/off, channel selection, screen setting, volume control, cursor movement on the screen, menu selection, and the like.

Here, the wireless input unit 200 may be a remote controller for remote control.

The user input interface unit 140 may transmit a signal input by the user through the command input unit 150 to the control unit 160 , or may transmit a signal from the control unit 160 to the command input unit 150 .

If the user inputs a predetermined command through the wired input unit 151 , the input command may be directly transmitted to the control unit 160 without going through the user input interface unit 140 .

The user input interface unit 140 receives and processes a command input from the wireless input unit 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method, or controls from the control unit 160 . The signal may be processed to be transmitted to the wireless input unit 200 .

Also, for example, the user input interface unit 140 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting key of the command input unit 150 to the control unit 160 . have.

The control unit 160 demultiplexes an input stream through the tuner 111 or the demodulator 112 or the external device interface unit 130 or processes the demultiplexed signals to generate a signal for video or audio output. can be created and printed.

The image signal processed by the control unit 160 may be input to the display unit 171 and displayed as an image corresponding to the image signal. Also, the image signal processed by the controller 160 may be input to an external output device through the external device interface unit 130 .

The audio signal processed by the controller 160 may be audio output to the sound output unit 172 . Also, the audio signal processed by the controller 160 may be input to an external output device through the external device interface unit 130 .

In addition, the controller 160 may control overall operations within the display apparatus 100 . For example, the controller 160 may control the tuner 111 to select a channel selected by a user or an RF broadcast corresponding to a pre-stored channel (Tuning).

Also, the control unit 160 may control the display apparatus 100 according to a user command input through the user input interface unit 140 or an internal program. In particular, by accessing a network, a user can download a desired application or an application list into the display apparatus 100 .

For example, the controller 160 controls the tuner 111 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface 140 . And it processes the video, audio, or data signal of the selected channel. The control unit 160 allows the user-selected channel information, etc. to be output through the display unit 171 or the sound output unit 172 together with the processed image or audio signal.

As another example, the control unit 160 receives an image signal or an audio signal from an external device or camcorder input through the external device interface unit 130 according to an external device image reproduction command received through the user input interface unit 140 . It enables output through the display unit 171 or the sound output unit 172 .

The controller 160 may control the display 171 to display an image. For example, the display unit ( 171) can be controlled. In this case, the image displayed on the display unit 171 may be a still image or a moving image, and may be a 2D image or a 3D image.

The controller 160 may control content to be reproduced. In this case, the content may be content stored in the display apparatus 100 , received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

In addition, the control unit 160 searches for a user terminal connected to the display device in a network through the network interface unit 113 , and outputs the searched user terminal list through the display unit 171 , and through the user input interface unit 140 . It is possible to control to receive a selection signal of a user terminal used as a user controller from among the searched user terminal list.

Also, the controller 160 may control to output player information corresponding to each user terminal through the display unit 171 .

The display unit 171 converts the image signal, the data signal, the OSD signal processed by the controller 160, or the image signal and the data signal received from the external device interface unit 130 into R, G, and B signals, respectively. A driving signal can be generated.

The display unit 171 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

On the other hand, the display unit 171 is configured as a touch screen, it is also possible to be used as an input device in addition to the output device.

The sound output unit 172 may receive a signal processed by the control unit 160 , for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and output it as sound. The sound output unit 172 may be implemented as various types of speakers.

The sound sensing unit 173 may sense a sound generated inside or outside the display apparatus 100 .

For example, the sound sensing unit 173 may sense various sounds, such as a telephone ringing sound, a doorbell sound, a water sound, and a user's voice, generated outside the display apparatus 100 . To this end, the sound sensing unit 173 may include a voice sensor or a microphone.

The motion sensing unit 174 may sense the user's motion. To this end, the motion sensing unit 174 may include a sensor unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor. The signal sensed by the sensor unit may be transmitted to the control unit 160 .

In addition, the motion sensing unit 174 may include a photographing unit (not shown) such as a camera. Image information captured by the photographing unit (not shown) may be input to the control unit 160 .

Alternatively, the motion sensing unit 174 may include a sensor unit and a photographing unit together.

The controller 160 may detect a user's gesture by individually or in combination with an image captured by a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

In addition, the motion sensing unit 174 may sense not only the user's motion, but also information such as the shape of the user's face and the direction the user's face is facing.

Meanwhile, the wireless input unit 200 may transmit a user input to the user input interface unit 140 . To this end, the wireless input unit 200 may use Bluetooth, Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the wireless input unit 200 may receive an image, audio, or data signal output from the user input interface unit 140 , and display the received information in the wireless input unit 200 or output voice or vibration.

On the other hand, the display apparatus 100 does not include the tuner 111 and the demodulator 112 , unlike the one shown in FIG. 3 , and receives image content through the network interface unit 113 or the external device interface unit 130 . and you can play it.

Meanwhile, although not shown in the drawings, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided.

The channel browsing processing unit receives the stream signal TS output from the demodulator 112 or the stream signal output from the external device interface 130, and extracts an image from the input stream signal to generate a thumbnail image. have. The generated thumbnail image may be input to the controller 160 as it is or encoded. Also, the generated thumbnail image may be encoded in a stream form and input to the controller 160 . The controller 160 may display a thumbnail list including a plurality of thumbnail images on the display unit 171 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

4 is a diagram for explaining a method of controlling the wireless input unit 200 . Hereinafter, descriptions of parts overlapping with the above-described parts will be omitted.

As shown in FIG. 4( a ), it is exemplified that a pointer 201 corresponding to the wireless input unit 200 is displayed on the display unit 171 . In this case, the pointer 201 may be a cursor.

The user may move or rotate the wireless input unit 200 up and down, left and right (FIG. 4(b)), back and forth (FIG. 4(c)).

In this case, the pointer 201 displayed on the display unit 171 of the display apparatus 100 may correspond to the movement of the wireless input unit 200 .

Since the wireless input unit 200 moves and displays the corresponding pointer 201 according to the movement in 3D space, it may be called a spatial remote controller.

FIG. 4B illustrates that when the user moves the wireless input unit 200 to the left, the pointer 201 displayed on the display unit 171 of the display apparatus 100 also moves to the left in response thereto.

Information on the movement of the wireless input unit 200 detected through the sensor of the wireless input unit 200 may be transmitted to the controller 160 of the display apparatus 100 .

The controller 160 may calculate the coordinates of the pointer 201 from information about the movement of the wireless input unit 200 . In addition, the display unit 171 of the display apparatus 100 may display the pointer 201 to correspond to the calculated coordinates.

4C illustrates a case in which the user moves the wireless input unit 200 away from the display unit 171 while pressing a specific button in the wireless input unit 200 . In this case, the selected area in the display unit 171 corresponding to the pointer 201 may be zoomed in and displayed.

Conversely, when the user moves the wireless input unit 200 closer to the display unit 171 , the selected area in the display unit 171 corresponding to the pointer 201 may be zoomed out and displayed in a reduced form.

Meanwhile, when the wireless input unit 200 moves away from the display unit 171 , the selection area may be zoomed out, and when the wireless input unit 200 approaches the display unit 171 , the selection area may be zoomed in.

Meanwhile, while a specific button in the wireless input unit 200 is pressed, recognition of vertical and horizontal movements may be excluded. That is, when the wireless input unit 200 moves away from or close to the display unit 171 , up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state in which a specific button in the wireless input unit 200 is not pressed, only the pointer 201 moves according to the movement of the wireless input unit 200 up, down, left, and right.

Meanwhile, the moving speed or moving direction of the pointer 201 may correspond to the moving speed or moving direction of the wireless input unit 200 .

Meanwhile, the pointer 201 may mean an object displayed on the display unit 171 in response to the operation of the wireless input unit 200 . Accordingly, objects of various shapes other than the arrow shape shown in the drawing are possible with the pointer 201 . For example, it may be a concept including a dot, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 201 may be displayed corresponding to any one point of the horizontal axis and the vertical axis on the display unit 171 , as well as being displayed corresponding to a plurality of points such as a line and a surface.

5 is a diagram for explaining the configuration of the wireless input unit 200 . Hereinafter, descriptions of parts overlapping with the above-described parts will be omitted.

Referring to FIG. 5 , the wireless input unit 200 includes a wireless communication unit 230 , a user input unit 270 , a sensor unit 250 , an output unit 240 , a power supply unit 210 , a storage unit 220 , and a control unit 260 . ), a microphone 280 may be included.

The wireless communication unit 230 may communicate with the control unit 160 of the display apparatus 100 according to the above-described embodiments of the present invention.

For example, the wireless input unit 200 may include an RF module 231 capable of transmitting and receiving signals to and from the control unit 160 via the user input interface unit 140 of the display apparatus 100 according to the RF communication standard. In addition, the wireless input unit 200 may include an IR module 232 capable of transmitting and receiving a signal according to the IR communication standard.

Here, the wireless input unit 200 may transmit a signal containing information regarding the movement of the wireless input unit 200 to the control unit 160 of the display apparatus 100 through the RF module 231 .

Also, the wireless input unit 200 may receive a signal transmitted by the control unit 160 of the display apparatus 100 through the RF module 231 . In addition, the wireless input unit 200 may transmit commands related to power on/off, channel change, volume change, etc. to the controller 160 of the display apparatus 100 through the IR module 232 as necessary.

The user input unit 270 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the display apparatus 100 through the wireless input unit 200 by manipulating the user input unit 270 .

When the user input unit 270 includes a hard key button, the user may input a command related to the display apparatus 100 to the wireless input unit 200 through a push operation of the hard key button.

When the user input unit 270 includes a touch screen, the user may input a command related to the display apparatus 100 through the wireless input unit 200 by touching a soft key of the touch screen.

In addition, the user input unit 270 may include various types of input means that the user can operate, such as a scroll key and a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit 250 may include a gyro sensor 251 or an acceleration sensor 252 .

The gyro sensor 251 may sense information regarding the movement of the wireless input unit 200 . For example, the gyro sensor 251 may sense information about the operation of the wireless input unit 200 based on the x, y, and z axes. The acceleration sensor 252 may sense information about the moving speed of the wireless input unit 200 . On the other hand, a distance measuring sensor (not shown) may be further provided, whereby the distance to the display unit 171 may be sensed.

The output unit 240 may output an image or audio signal corresponding to a manipulation of the user input unit 270 or a signal transmitted from the control unit 160 of the display apparatus 100 .

Through the output unit 240 , the user may recognize whether the user input unit 270 is operated or whether the display apparatus 100 is controlled.

As an example, the output unit 240 includes an LED module 241 that is turned on when the user input unit 270 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 230, and a vibration module 242 that generates vibration. , a sound output module 243 for outputting sound, or a display module 244 for outputting an image may be provided.

The power supply unit 210 may supply power to each component of the wireless input unit 200 . The power supply unit 210 may reduce power consumption by stopping the power supply when the wireless input unit 200 does not move for a preset period of time. The power supply unit 210 may resume power supply when a predetermined key provided in the wireless input unit 200 is operated.

The storage 220 may store various types of programs and application data required for control or operation of the wireless input unit 200 . If the wireless input unit 200 transmits and receives signals wirelessly through the display device 100 and the RF module 231 , the wireless input unit 200 and the display device 100 transmit and receive signals through a preset frequency band. can The control unit 260 of the wireless input unit 200 may store and reference information about a frequency band in which a signal can be wirelessly transmitted and received with the display device 100 paired with the wireless input unit 200 in the storage unit 220 . have.

The microphone 280 may input sound generated outside the wireless input unit 200 and convert it into audio data. The converted audio data is transmitted to the control unit 260 , and the control unit 260 may transmit it to the display apparatus 100 through the RF module 231 .

The controller 260 may control overall matters related to the control of the wireless input unit 200 . The control unit 260 transmits a signal corresponding to a preset key operation of the user input unit 270 or a signal corresponding to the movement of the wireless input unit 200 sensed by the sensor unit 250 to the display device ( 100) can be transmitted. It is also possible to display corresponding to a plurality of points, such as a line (line), a surface (surface).

Before looking at the embodiments of the present invention, it is necessary to look at the operation of the display device according to the prior art. 6 is an example of a diagram related to an operation of a display device according to the related art.

6A is a view for explaining a voice recognition mode of a display apparatus according to the related art. In a state in which content is being displayed, the user may operate the display device using a button formed on the remote control 31 . As shown in FIG. 6( a ), a voice recognition button 32 is formed on the remote control 31 , and when the voice recognition button 32 is selected, the display device may be switched to a voice recognition mode. Accordingly, by uttering a speech to the display device in the voice recognition mode, the user may perform an operation according to voice recognition on the display device. As shown in FIG. 6A , a search window 34 may be formed in one area of the display unit, and a user's voice may be converted into text and displayed in the search window 34 .

Here, referring to FIG. 6A , the cursor 35 or the pointer is not displayed on the display unit 33 . This is because the current display device is switched to the voice recognition mode, and the display device performs only an operation according to the user's voice. That is, the display device is operated by a user's voice, and can be controlled only by a signal corresponding to the voice recognition button 32 among the signals of the remote control 31 .

Therefore, in order to perform an operation by the cursor 35 or the pointer, the voice recognition mode must be released by selecting the voice recognition button 32 formed on the remote control 31 once more. That is, referring to FIG. 6B , in the voice recognition mode, the user may select the voice recognition button 32 formed on the remote control 31 . Accordingly, the voice recognition mode of the display device is released, and the cursor 35 is displayed on the display unit 33 . In a state in which the voice recognition mode is released, the user may select one of at least one item included in the list with the cursor 35 .

As described above, according to the display apparatus according to the prior art, when the voice recognition mode is set, the cursor 35 disappears and only the user's voice is recognized. In addition, the cursor 35 can be displayed on the screen only when the voice recognition mode is released. Therefore, it is necessary to enable easy and fast user manipulation by enabling manipulation according to the cursor 35 even in the voice recognition mode.

7 is an example of a flowchart related to a control method of the display apparatus 100 according to an embodiment of the present invention. Hereinafter, descriptions of parts overlapping with the above description will be omitted.

Referring to FIG. 7 , the display apparatus 100 in the voice recognition mode may receive a user voice signal and a cursor signal, respectively ( S710 ). The user voice signal may be a signal corresponding to the voice uttered by the user. The cursor signal may be a signal including coordinate information of a cursor on the display unit 171 according to movement of the remote controller 200 .

Also, the display apparatus 100 in the voice recognition mode may receive a control signal. The control signal may mean various signals for controlling the display apparatus 100 by the remote control 200 .

Also, the display apparatus 100 may be set to always be in the voice recognition mode. Meanwhile, the display apparatus 100 may include a sound sensing unit 173 for sensing a sound generated outside the display apparatus 100 such as a user's voice signal. The controller 160 may receive a user voice signal through the sound sensing unit 173 . Accordingly, when the preset user voice signal is sensed, the controller 160 may execute a voice recognition mode to perform subsequent operations according to the user voice signal. For example, if the user utters “TV”, it is assumed that the controller 160 executes the voice recognition mode. Therefore, when “Turn up the TV volume” is uttered, the controller 160 may perform an operation to increase the volume.

In addition, when a voice recognition button (not shown) formed on the remote control 200 is selected, the display apparatus 100 may be switched to a voice recognition mode. In this case, the controller 260 of the remote control 200 may receive the user's voice through the microphone 280 built into the remote control 200 . Accordingly, the controller 260 may convert the received user voice into a voice signal and transmit it to the display apparatus 100 through the RF module 231 . For example, when the user utters “volume up” while a voice recognition button (not shown) formed on the remote control 200 is selected, the control unit 260 converts it into a voice signal and transmits it to the display device 100 . have. Accordingly, the control unit 160 of the display apparatus 100 may perform an operation of increasing the volume in response to the received user voice signal.

After that, when the voice recognition button (not shown) formed on the remote control 200 is selected once more, the display apparatus 100 may release the voice recognition mode. cursor signal

Hereinafter, a case in which a voice recognition button (not shown) formed on the remote control 200 is selected will be described.

Meanwhile, the display apparatus 100 may simultaneously receive a user voice signal, a cursor signal, and a control signal through the user input interface unit 140 .

Thereafter, the display apparatus 100 may display the text corresponding to the user's voice signal received in the voice recognition mode on the display unit 171 (S720).

Specifically, in the voice recognition mode, the user may utter a command to operate the display apparatus 100 . That is, the user may utter a query to be searched through the display apparatus 100 . For example, if the user wants to search for “AAA”, the user may utter “AAA” or “Search for AAA”.

Thereafter, the controller 160 may receive the user's voice signal and convert it into text. The converted text may be displayed on one area of the display unit 171 . Since a technique for converting a user's voice signal into text is a known technique, a detailed description thereof will be omitted.

Meanwhile, in the voice recognition mode, the control unit 160 may receive a control signal including a cursor signal, and the control unit 160 may perform an operation according to the received control signal. For example, even while the user voice signal is being received or the user voice signal is being converted to text, the controller 160 may display the cursor 201 at a point on the display unit 171 in response to the received cursor signal. can Accordingly, the controller 160 may perform various operations, such as switching a screen or selecting an item, in response to the received control signal.

Thereafter, the display apparatus 100 may perform an operation according to the user's voice signal using the cursor signal and the control signal (S730). That is, in a state in which the voice recognition mode is maintained, the display apparatus 100 may perform an operation according to the combination of the text converted from the user's voice signal and the cursor signal.

Specifically, the user may be in a state in which “search me” is uttered, and the cursor 201 may be in a state in which a specific item is selected. In this case, the controller 160 may perform a command corresponding to “search for” on the item selected by the remote controller 200 . Accordingly, if the item selected by the cursor 201 is “AAA”, the controller 160 may display a search result for “AAA”.

Therefore, according to the present invention, since the operation of the display apparatus 100 can be controlled not only by the user's voice signal but also by the cursor according to the movement of the remote control in the voice recognition mode, the user's convenience and intuition can be improved.

In addition, since various operations according to the user's voice signal and cursor movement are possible, functions implemented in the voice recognition mode may increase.

Hereinafter, a detailed operation of the display apparatus 100 will be described as an example. 8 to 16 are various examples of drawings for explaining the operation of the display apparatus 100 according to an embodiment of the present invention. Hereinafter, descriptions of parts overlapping with the above description will be omitted.

8 is a diagram illustrating an example of a screen configuration in a voice recognition mode. Referring to FIG. 8 , a query area 181 , a list area 182 , and a content area 184 may be formed in the display unit 171 .

Content may be displayed in the content area 184 . For example, in the content area 184 , various contents such as a broadcast program received from a broadcasting station or a still image or a moving picture stored in the storage unit 120 or received from the external device 30 may be displayed. When not in the voice recognition mode or when a user voice signal is not received in the voice recognition mode, only the content area 184 may be formed on the display unit 171 .

Also, when the display apparatus 100 receives a user voice signal from the remote control 200 in the voice recognition mode, the controller 160 may convert the received user voice signal into text and display it on the query area 181 . In this case, text to be searched or executed, that is, a query is displayed in the query area 181 , and the query area 181 may be a search window.

Also, the controller 160 may transmit a query to the search server 20 , and the search server 20 may transmit a search result corresponding to the received query to the display apparatus 100 . Accordingly, the controller 160 may display the search result received from the search server 20 on the list area 182 .

Also, the user may select one of at least one content list that is a search result displayed on the list area 182 . The controller 160 may execute one selected content and display it on the content area 184 . In this case, as shown in FIG. 8 , the content area 184 may be formed in only a partial area of the display unit 171 , and as shown in FIG. 9 , the content area 184 is in the entire area of the display unit 171 . may be formed.

Meanwhile, the controller 160 may provide a preset visual effect to one of the content lists displayed on the list area 182 in which the cursor 201 is positioned.

Specifically, referring to FIG. 8 , a plurality of content lists, which are search results according to a query, are displayed in the list area 182 . The user may position the cursor 201 on any one of the contents list by using the remote control 200 . In this case, the controller 160 may provide various visual effects, such as displaying the content on which the cursor 201 is located in a color contrasting with other unselected content, increasing the size, or increasing the luminance.

Meanwhile, the control unit 160 may automatically display information on one of the content lists displayed on the list area 182 on which the cursor 201 is located in either the content area 184 or the list area 182 .

Specifically, referring to FIG. 8 , a plurality of content lists are displayed in the list area 182 , and the user can position the cursor 201 on any one of the content lists by using the remote control 200 . In this case, the controller 160 may automatically execute the content on which the cursor 201 is located and display it on the content area 184 , as shown in FIG. 9 . As shown in FIG. 9 , a logo 192 or a name of a broadcast or program may be displayed on one side of the content area 184 .

Also, as shown in FIG. 8 , in a state where the cursor 201 is positioned on any one of the plurality of content lists, the user may utter “execute”. In this case, the controller 160 may receive a user voice signal and execute a command corresponding thereto. Accordingly, as shown in FIG. 9 , the controller 160 may execute the content on which the cursor 201 is located and display it on the content area 184 .

In addition, as shown in FIG. 8 , in a state where the cursor 201 is positioned on any one of the plurality of content lists, the user may select an execution button (not shown) formed on the remote controller 200 . In this case, the controller 160 may receive a control signal corresponding to the selected execution button and execute an operation corresponding thereto. Accordingly, as shown in FIG. 9 , the controller 160 may execute the content on which the cursor 201 is located and display it on the content area 184 .

Meanwhile, the controller 160 may select at least a portion of the displayed text using the remote controller 200 . In FIG. 10 , various examples for modifying text displayed in the query area 181 will be described.

Referring to FIG. 10A , text corresponding to an uttered user voice may be displayed in the query area 181 . Here, the user may wish to search for “AAB” rather than the displayed “AAA”.

Accordingly, the user can position the cursor 201 on the text to be edited. In this case, the controller 160 displays an underline at the bottom of the text in which the cursor 201 is positioned as shown in FIG. Polygons can be displayed for the whole. In addition to this, various visual effects such as displaying the text on which the cursor 201 is located in a color contrasting with other unselected text, increasing the size, or increasing the luminance may be applied. Accordingly, the user can visually distinguish the text to be edited from other texts.

Meanwhile, the controller 160 may select a part of the displayed text by a drag operation through the remote controller 200 . Referring to FIG. 10(c) , the user wants to correct the second and third characters among the three characters. The user can select up to the third character by dragging after positioning the cursor 201 on the displayed second character.

In this case, a touch pad (not shown) or a click button (not shown) may be formed on the remote control 200 , and the user may position the cursor 201 on the second character and then touch the touch pad (not shown) or A click button (not shown) may be pressed. Thereafter, the cursor 201 may be moved up to the third character while maintaining a touch operation on a touch pad (not illustrated) or a pressing operation on a click button (not illustrated). When the cursor 201 moves to the third character, the user selects a character as shown in FIG. This can be done.

Meanwhile, in a state in which a character to be modified is selected by the method shown in FIGS. 10A to 10C , the user may modify or replace the query by uttering a voice corresponding to a new character or text. In addition, in a state in which a character to be modified or added is selected, the user may modify the query by inputting new characters or text using a touch pad (not shown) or a character button (not shown) formed on the remote control 200 . .

For example, if the user modifies the query to “ABC”, as shown in FIG. 11 , a search result according to the modified or replaced query “ABC” may be displayed in the list area 182 .

Meanwhile, the controller 160 may add characters or texts by positioning the cursor 201 at an arbitrary position among the displayed text. Referring to FIG. 10( d ), the user wants to add a character or text to the displayed text. In this case, the user utters a voice corresponding to a new character or text, or a touch pad (not shown) or a character button (not shown) formed on the remote control 200, while positioning the cursor 201 to the right of the displayed last character. You can modify the query by entering new characters or text using

For example, if the user adds “MUSIC” to the query displayed as shown in FIG. 11, a new query “ABC MUSIC” is displayed in the query area 181 as shown in FIG. may be displayed in area 182 .

Meanwhile, referring to FIG. 10E , a retry button 183 may be formed on one side of the query area 181 in which text is displayed. When the user does not want to search for the text displayed in the query area 181 , the user may select the retry button 183 . In this case, the controller 160 may delete the text displayed on the query area 181 , and the user may utter a voice corresponding to the text to be searched. Specific examples are the same as described above.

Accordingly, while the screen shown in FIG. 12 is displayed, the user can position the cursor 201 on the content to be executed. In this state, when the user selects an execution button (not shown) formed on the remote control 200 , the selected content may be executed and displayed on the content area 184 , as shown in FIG. 13 .

Meanwhile, in a state where the cursor 201 is positioned on any one of the content lists displayed on the list area 182 , the controller 160 may display information about one content on which the cursor 201 is positioned.

For example, it is assumed that a screen as shown in FIG. 8 is displayed. Here, the user wants to view information on any one of the contents included in the list area 182 . In this case, the user may position the cursor 201 on the corresponding content.

After this, the user can utter “information” or “show information”. In this case, the controller 160 may recognize a voice signal corresponding to “information” or “show information”, which is a voice uttered by the user, as an information output command for the content in which the cursor 201 is located. In addition, the user may select an information button (not shown) formed on the remote control 200 . In this case, the controller 160 may recognize the control signal corresponding to the selected information button (not shown) as an information output command for the content in which the cursor 201 is located.

Accordingly, the controller 160 may display information about the content on which the cursor 201 is positioned, as shown in FIG. 14 .

Meanwhile, in a state where the cursor 201 is positioned on any one of the content lists displayed on the list area 182 , the controller 160 may execute one content on which the cursor 201 is positioned.

For example, it is assumed that a screen as shown in FIG. 8 is displayed. Here, the user wants to execute any one of the contents included in the list area 182 . In this case, the user may position the cursor 201 on the corresponding content.

After this, the user can utter “choice” or “execute”. In this case, the controller 160 may recognize a voice signal corresponding to “selection” or “execution”, which is a voice uttered by the user, as an execution command for the content in which the cursor 201 is located. In addition, the user may select a selection button (not shown) or an execution button (not shown) formed on the remote control 200 . In this case, the controller 160 may recognize a control signal corresponding to such a button (not shown) as an execution command for the content on which the cursor 201 is located.

Accordingly, the controller 160 can execute the content on which the cursor 201 is located, as shown in FIG. 15 .

Meanwhile, while the cursor 201 is positioned on any one of the content lists displayed on the list area 182 , the controller 160 may delete one content on which the cursor 201 is positioned from the content list.

For example, it is assumed that a screen as shown in FIG. 8 is displayed. Here, the user wants to delete any one of the contents included in the list area 182 . In this case, the user may position the cursor 201 on the corresponding content.

After this, the user can utter “delete”. In this case, the controller 160 may recognize a voice signal corresponding to “delete”, which is a voice uttered by the user, as a delete command for the content on which the cursor 201 is located. In addition, the user may select a delete button (not shown) formed on the remote control 200 . In this case, the controller 160 may recognize the control signal corresponding to the delete button (not shown) as a delete command for the content in which the cursor 201 is located.

Accordingly, the controller 160 may delete the content on which the cursor 201 is located from the content list, as shown in FIG. 16 .

17 is an example of a flowchart related to a control method of the display apparatus 100 according to another embodiment of the present invention. Hereinafter, descriptions of parts overlapping with the above description will be omitted.

Referring to FIG. 17 , the display apparatus 100 may execute content. Specifically, the controller 160 may execute the content and display it on the display unit 171 . In this case, the content may mean a broadcast program received from a broadcasting station or a still image or a moving image stored in the storage unit 120 or received from an external device. While the display apparatus 100 is displaying content, the display apparatus 100 may be switched to a voice recognition mode.

After that, the display apparatus 100 in the voice recognition mode may receive a cursor signal (S1710). Specifically, the control unit 160 may receive a cursor signal through the user input interface unit 140 . The cursor signal is a signal corresponding to the movement of the cursor 201 , and may be a signal including coordinate information of the cursor on the display unit 171 according to the movement of the remote control 200 .

Also, the display apparatus 100 may select an image using the cursor 201 (S1720). Specifically, the user may adjust the direction of the remote control 200 so that the cursor 201 is positioned on an image to be selected among at least one image displayed on the display unit 171 . In this case, the controller 160 may visually distinguish the selected image from other unselected images. This will be described later.

Thereafter, the display apparatus 100 may receive a user voice signal (S1730). A detailed description of receiving the user's voice signal is the same as described in FIG. 7 .

Thereafter, the display apparatus 100 may display a text corresponding to the user's voice signal (S1740). Specifically, the controller 160 may convert the received user voice signal into text and display it on the display unit 171 . Since a specific method for converting a user's voice signal into text is a known technique, a detailed description thereof will be omitted.

In this case, the display apparatus 100 may perform an operation according to the user's voice signal using a cursor signal or a control signal. For example, while one of the displayed images is selected by the cursor 201 , the user may utter a command to execute a specific operation. As described above, the uttered user voice signal is converted into text and displayed on the display unit 171 .

Accordingly, the display apparatus 100 may display an operation result according to the text (S1750). Specifically, the controller 160 may execute a specific operation with respect to the selected image.

Hereinafter, it will be described as a specific example.

18 to 25 are various examples of drawings for explaining the operation of the display apparatus 100 according to another embodiment of the present invention. Hereinafter, descriptions of parts overlapping with the above description will be omitted.

18 is a diagram illustrating an example of a screen configuration in a voice recognition mode. Referring to FIG. 18 , the controller 160 is in a state in which content is being executed. Also, an image including at least one object is displayed in the content area 184 .

In this case, the user may position the cursor 201 with respect to one of the displayed at least one object. As shown in FIG. 18 , when the cursor 201 is positioned on a specific object, the user can utter a desired command. For example, the user can utter “Search for” or “What is this?” In this case, as described above, the text corresponding to the user's voice uttered may be displayed in the query area 181 formed on one side of the display unit 171 as shown in FIG. 20 .

Thereafter, the controller 160 may execute a command corresponding to the user's voice. That is, in the case of the above-described example, the controller 160 may perform a search for a specific object on which the cursor 201 is located. Specifically, the controller 160 transmits an image of the object on which the cursor 201 is located to the search server 20 . The search server 20 may search for an image matching the received image, and transmit the result to the display apparatus 100 . Accordingly, the control unit 160 receiving the search result may display it on the display unit 171 .

Thereafter, the control unit 160 may display the search result in the list area 182 formed in one area of the display unit 171 . This is as shown in FIG. 20 .

Meanwhile, the user may select the displayed text image. Here, the text image is an image representing text, and may mean displayed by executing an image file instead of a text file. For example, while the subtitle 191 of the screen shown in FIG. 19 is text, a portion of the screen shown in FIG. 19 that corresponds to an image obtained by photographing text, for example, “BBB BEER”, may be a text image. have.

Thereafter, the user may select the displayed text image by a drag operation through the remote control 200 . The drag operation is as described above, and the resulting screen is as shown in FIG. 19 . In this case, the controller 160 may convert the selected text image into text. Since a method of converting an image, which is a text file, into a text, which is a text file, is a well-known technique, the details will be omitted.

19 , after the user selects a specific text image with the cursor 201, the user can utter a desired command. In this case, the controller 160 may provide various visual effects, such as displaying the text image selected with the cursor 201 in a color contrasting with other images not selected, increasing the size, or increasing the luminance.

Thereafter, the controller 160 may execute a command corresponding to the user's voice. Specifically, the controller 160 transmits the converted text from the specific text image selected with the cursor 201 to the search server 20 . The search server 20 may search for the received text and transmit the result to the display apparatus 100 . Accordingly, the control unit 160 receiving the search result may display it on the display unit 171 .

Thereafter, the control unit 160 may display the search result in the list area 182 formed in one area of the display unit 171 . This is as shown in FIG. 20 .

Meanwhile, only the case of displaying the search result has been described in FIGS. 18 to 20 , but the present invention is not limited thereto. That is, it can be applied to various fields such as e-commerce.

For example, as shown in FIG. 21 , the controller 160 may execute content. Also, an image including at least one object is displayed in the content area 184 .

Thereafter, the user may select one object as the cursor 201 and utter “how much?”. In this case, the controller 160 may convert the user voice signal into text and display it on the query area 181 .

Also, the controller 160 may transmit one selected object to the search server 20 in order to search for the selected image. The search server 20 may search for the price of the received image and transmit the result to the display apparatus 100 . Accordingly, the control unit 160 receiving the search result may display it on the list area 182 . This is as shown in FIG. 22 .

Thereafter, the user may select one of the at least one item displayed on the list area 182 with the cursor 201 and then utter “buy”. In this case, the controller 160 may convert the user voice signal into text and display it on the query area 181 .

In addition, the controller 160 may access a server for the selected item and proceed with a transaction for the product. This is as shown in FIG. 23 .

On the other hand, when the cursor 201 is positioned on one object displayed on the display unit 171 , the control unit 160 may execute an operation on the corresponding object using a user's voice.

24 illustrates a state in which the display apparatus 100 is executing a game.

In the voice recognition mode, the user may position the cursor 201 on the object 190 on the right, as shown in the left diagram of FIG. 24 . After this, the user can utter a desired command. For example, the user may utter “KICK”.

Accordingly, as shown in the right drawing of FIG. 24 , the object 190 on the right side where the cursor 201 is positioned may perform an operation according to the uttered user voice. In this case, as described above, text corresponding to the uttered user's voice may be displayed.

In this case, the controller 160 may provide various visual effects to the object 190 on which the cursor 201 is located, such as displaying a color contrasting with other unselected objects, increasing the size, or increasing the luminance. have.

25 exemplifies a state in which the display apparatus 100 is executing a spatial movement simulation.

In the voice recognition mode, the user may position the cursor 201 in the space between No. 3 and No. 4 as shown in the left diagram of FIG. 25 . After this, the user can utter “MOVE”.

Accordingly, as shown in the right drawing of FIG. 25 , a screen in which the viewpoint is moved based on the position of the cursor 201 may be displayed. In this case, as described above, text corresponding to the uttered user's voice may be displayed.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. In addition, it also includes being implemented in the form of a carrier wave (eg, transmission through the Internet). In addition, the computer may include the control unit 180 of the display device. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

100: display device 110: receiver
120: storage unit 130: external device interface unit
140: user input interface unit 150: command input unit
160: control unit 170: driving unit

Claims (19)

A display device controllable by a remote control, comprising:
display unit;
a user input interface for receiving a user voice signal and a cursor signal from the remote control in a voice recognition mode; and
During the voice mode, the position of the cursor is adjusted to a position corresponding to the movement of the remote control in 3D space according to the cursor signal during the voice mode, and text corresponding to the received user voice signal is displayed on the display unit; Including; a control unit that executes a specific operation related to the location according to the user's voice signal;
The control unit is
forming a content area in which content is displayed, a query area in which the text is displayed, and a list area in which a search result corresponding to the displayed text is displayed on the display unit,
The display apparatus according to claim 1, wherein, when a preset user voice signal is received while a cursor is positioned on any one of the content lists displayed in the list area, one content on which the cursor is positioned is executed. delete delete According to claim 1,
The control unit is
A display apparatus, characterized in that a preset visual effect is applied to one of the content lists displayed in the list area where the cursor is located. delete delete delete delete delete According to claim 1,
The control unit is
and selecting at least a part of the displayed text with the remote control. 11. The method of claim 10,
The control unit is
A display device, characterized in that a part of the displayed text is selected by a drag operation through the remote control. 11. The method of claim 10,
The control unit is
and replacing the selected text with text corresponding to the received user voice signal. 13. The method of claim 12,
The control unit is
and displaying a search result corresponding to the replaced text on the list area. A display device controllable by a remote control, comprising:
display unit;
a user input interface for receiving a user voice signal and a cursor signal from the remote control in a voice recognition mode; and
During the voice mode, the position of the cursor is adjusted to a position corresponding to the movement of the remote control in 3D space according to the cursor signal during the voice mode, and text corresponding to the received user voice signal is displayed on the display unit; Including; a control unit that executes a specific operation related to the location according to the user's voice signal;
The control unit is
Select the image displayed in the content area with the cursor,
When a preset user voice signal is received, an operation corresponding to the received user voice signal is executed with respect to the selected image. 15. The method of claim 14,
The image is a text image,
The control unit is
and executing an operation corresponding to the received user voice signal with respect to the text in which the text image is converted. A display device controllable by a remote control, comprising:
display unit;
a user input interface for receiving a user voice signal and a cursor signal from the remote control in a voice recognition mode; and
During the voice mode, the position of the cursor is adjusted to a position corresponding to the movement of the remote control in 3D space according to the cursor signal during the voice mode, and text corresponding to the received user voice signal is displayed on the display unit; Including; a control unit that executes a specific operation related to the location according to the user's voice signal;
The control unit is
When a preset user voice signal is received while a cursor is positioned on one object displayed on the display unit, an operation corresponding to the received user voice signal is executed with respect to one object on which the cursor is positioned display device. 17. The method of claim 16,
The control unit is
A display device, characterized in that a preset visual effect is applied to the one object. A display device controllable by a remote control, comprising:
display unit;
a user input interface for receiving a user voice signal and a cursor signal from the remote control in a voice recognition mode; and
During the voice mode, the position of the cursor is adjusted to a position corresponding to the movement of the remote control in 3D space according to the cursor signal during the voice mode, and text corresponding to the received user voice signal is displayed on the display unit; Including; a control unit that executes a specific operation related to the location according to the user's voice signal;
The control unit is
When a preset user voice signal is received while the cursor is positioned on one side of the screen displayed on the display unit, the entire screen is changed based on the position of the cursor in response to the received user voice signal display device.
delete

Images