KR101708646B1 - Image Display Device and Method for Operating the Same - Google Patents

Abstract

The present invention relates to an image display device capable of installing an application and an operation control method thereof. More particularly, the present invention relates to an image display device and an operation control method thereof that can download and install an application through a network server. The video display device according to an embodiment of the present invention can display the broadcast content video, application related video, and application related information installed through the broadcasting station through one screen. The user can use various kinds of image display devices after downloading and installing various applications with the image display device according to the present invention.

Description

TECHNICAL FIELD [0001] The present invention relates to an image display device, a system thereof, and an object search method displayed on the image display device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device, a system thereof, and an operation control method thereof, and more particularly, to an image display device, a system thereof, and a method of controlling the operation thereof.

The video display device is a device having a function of displaying an image that the user can view. The user can view the broadcast through the video display device. The video display device displays the broadcast selected by the user among the broadcast signals transmitted from the broadcast station on the display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

The remote control device is a device capable of remotely controlling the video display device. The remote control device transmits the signal included in the instruction corresponding to the user operation to the image display device. The operation of the video display device is controlled in accordance with a command included in the signal transmitted from the remote control device.

It is an object of the present invention to provide an image display device, a system thereof, and an operation control method thereof that can improve the usability of the user.

It is also an object of the present invention to provide a video display device, a system thereof, and an operation control method thereof that can easily acquire information desired by a user.

It is another object of the present invention to provide an image display device capable of providing various user interfaces, a system thereof, and an operation control method thereof.

The present invention also provides a method and system for searching an object in an image display device capable of installing an application.

According to another aspect of the present invention, there is provided a method for searching an object displayed on a video display device, the method comprising: displaying a screen including at least one object on a display unit; Receiving an object selection command included in the screen; Selecting an object corresponding to the received selection command; Searching for keyword or attribute information corresponding to the selected object; Searching application or online information related to the searched keyword or attribute information; And displaying the search result on the display unit.

According to another aspect of the present invention, there is provided an image display apparatus including: a display unit displaying a screen including at least one object; And a display control unit for receiving an object selection command included in the screen, selecting an object corresponding to the received selection command, searching keyword or attribute information corresponding to the selection object, An application or online information, and displaying the search result on the display unit.

According to another aspect of the present invention, there is provided an image display device system including a display unit displaying a screen including at least one object, receiving an object selection command included in the screen, A video display device for selecting an object corresponding to the received selection command; And searching for keywords or attribute information corresponding to the selected object, searching application or online information related to the searched keyword or attribute information, and displaying the search result on the display unit of the video display device And a brokering server for transmitting a video signal to the image display device.

According to the embodiment of the present invention, the user of the video display device can install the application in the video display device. Further, when the video display device displays a screen including at least one object, the user of the video display device can select an object to be searched. For example, a user of a video display device can select an object to be searched using a remote control device of the video display device.

The broker server connected to the video display device or the video display device determines a keyword or the like corresponding to the object selected by the user. Then, the video display device or the brokering server queries the determined keyword or the like with the Internet search engine or the application providing server. The Internet search engine or application providing server transmits the result corresponding to the query to the video display device or the brokering server. The video display device can display a result corresponding to the query on the screen of the video display device.

Accordingly, the user can confirm the object related information included in the screen viewed through the video display device through the video display device.

1 is a schematic view of an image display device system according to an embodiment of the present invention.
2 is an internal block diagram of an image display device according to an embodiment of the present invention.
3 is a view showing an apparatus capable of transmitting and receiving data with the video display device of FIG.
FIG. 4 is an internal block diagram of the control unit of FIG. 2. FIG.
5 to 6 are views showing various examples of the platform structure of the video display device of FIG.
FIG. 7 is a diagram showing the operation of the remote control apparatus of FIG. 2. FIG.
8 is an internal block diagram of the remote control device of FIG.
FIG. 9 and FIG. 10 are diagrams for explaining various examples of a method of operating an image display device according to an embodiment of the present invention.
FIG. 11 and FIG. 12 are diagrams referred to in explaining an object searching method displayed on an image display device according to an embodiment of the present invention.
13 to 16 are views showing screens displayed on an image display device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

<Description of FIG. 1 to FIG. 10>

Meanwhile, the video display device described in the present specification is an intelligent video display device to which a computer support function is added to a broadcast reception function, and is equipped with an Internet function while being faithful to a broadcast reception function, It can be equipped with a more convenient interface such as a space remote controller. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

That is, since various applications can be freely added or deleted on the general-purpose OS kernel, the video display device described in the present invention can perform various user-friendly functions. For example, it may be a smart TV.

1 is a schematic view of an image display device system according to an embodiment of the present invention.

The video display device system according to the embodiment of the present invention may include a content provider (CP) 10, a service provider (Service) (SP) 20, a network provider (NP) 30, and a user 40.

The content provider 10 produces and provides various contents. 1, a terrestrial broadcaster, a cable SO (System Operator), a MSO (Multiple System Operator), a satellite broadcaster, Internet broadcaster and the like can be exemplified.

In addition, the content provider 10 may provide various applications in addition to the broadcast content. This will be described later with reference to Fig. 5 and the following.

The service provider 20 can provide the contents provided by the contents provider 10 in a service package. For example, the service provider 20 of FIG. 1 can package and provide the first terrestrial broadcast, second terrestrial broadcast, cable MSO, satellite broadcast, various Internet broadcasts, applications, etc. to the user.

Meanwhile, the service provider 20 can provide a service to the user 40 by using a unicast or multicast method. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in a unicast method, when a receiver requests data from a server, the server can transmit data to the receiver upon request. The multicast method is a method of transmitting data to a plurality of receivers of a specific group. For example, the server can transmit data to a plurality of pre-registered receivers at once. An Internet Group Management Protocol (IGMP) protocol may be used for multicast registration.

The network provider 30 may provide a network for providing services to the user 40. The user 40 may construct a home network end user (HNED) to receive a service.

Conditional access or content protection may be used as means for protecting contents transmitted from the video display device system. As an example of such restriction reception or content protection, a scheme such as a cable card (CableCARD) and a DCAS (Downloadable Conditional Access System) may be used.

On the other hand, the user 40 can also provide the content through the network. In this case, conversely, conversely, conversely, the user 40 may be a content provider and the content provider 10 may receive content from the user 40. [ Thereby enabling bidirectional content services or data services.

2 is an internal block diagram of an image display device according to an embodiment of the present invention.

2, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user input interface unit 150, A control unit 170, a display unit 180, an audio output unit 185, and a power supply unit 190. The broadcast receiving unit 105 may include a tuner 110, a demodulating unit 120, and a network interface unit 130. The tuner 110 and the demodulator 120 may be selectively provided with the network interface unit 130.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 110 can be directly input to the controller 170.

Also, the tuner 110 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner 110 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs an 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulation unit 120 may perform channel decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulating unit 120 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs the video to the display unit 180 and audio to the audio output unit 185.

The external device interface unit 135 can connect the external device and the video display device 100. [ To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface unit 135 transmits external video, audio, or data signals to the controller 170 of the video display device 100 through a connected external device. Also, the control unit 170 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The video display device 100 is connected to a communication network such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, DLNA (Digital Living Network Alliance) Depending on the standard, it can be networked with other electronic devices.

Also, the external device interface unit 135 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

Meanwhile, the external device interface unit 135 may receive the application or application list in the adjacent external device, and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The network interface unit 130 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. The network interface unit 130 may include an Ethernet terminal or the like for connection to a wired network and may be a WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless) broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 130 can access a predetermined web page via the network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 130 can select and receive a desired application among applications open to the public via a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

The storage unit 140 may also function to temporarily store video, audio, or data signals input from the external device interface unit 135 or the network interface unit 130. In addition, the storage unit 140 may store information on a predetermined broadcast channel through the channel memory function.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 130. [

The storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The video display device 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

FIG. 2 illustrates an embodiment in which the storage unit 140 is provided separately from the controller 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be configured to turn on / off the power, select the channel, and display the screen from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared Or a control signal from the control unit 170 to the remote control device 200. The remote control device 200 may be configured to receive the control signal from the control unit 170. [

For example, the user input interface unit 150 may transmit a user input signal or a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170 have.

For example, the user input interface unit 150 may transmit a user input signal or a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 170, (Not shown) can be transmitted. Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 135 to generate a signal for video or audio output Can be generated and output.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 2, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 may control the image display device 100 according to a user command or an internal program input through the user input interface unit 150. In particular, the user can access the network and download a list of applications or applications desired by the user to the video display device 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The control unit 170 allows the display unit 180 or the audio output unit 185 to output the video or audio signal processed by the user through the channel information or the like selected by the user.

For example, the control unit 170 may control the operation of the external device through the external device interface unit 135, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 150 So that the video signal or the audio signal of the audio signal output through the display unit 180 or the audio output unit 185 can be outputted.

Meanwhile, the control unit 170 may control the display unit 180 to display an image. For example, the broadcast image input through the tuner 110, the external input image input through the external device interface unit 135, the image input through the network interface unit, or the image stored in the storage unit 140 may be displayed on the display unit 180). &Lt; / RTI &gt; At this time, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

On the other hand, when entering the application viewing item, the control unit 170 can control to display a list of applications or applications that can be downloaded from the video display device 100 or from an external network.

The control unit 170 can control, in addition to various user interfaces, to install and drive an application downloaded from the external network. Further, it is possible to control so that an image related to the executed application is displayed on the display unit 180 by the user's selection.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 135 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be directly or encoded and input to the controller 170. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display unit 180 using the input thumbnail images. On the other hand, the thumbnail images in this thumbnail list can be updated in sequence or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170 or a video signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively Thereby generating a driving signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

Meanwhile, the display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the control unit 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

On the other hand, a photographing unit (not shown) for photographing a user can be further provided. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. The image information photographed by the photographing unit (not shown) is input to the control unit 170.

In order to detect the user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further included in the image display device 100 have. A signal sensed by a sensing unit (not shown) may be transmitted to the controller 170 through the user input interface unit 150.

The control unit 170 may sense the gesture of the user by combining the images photographed by the photographing unit (not shown) or the signals sensed by the sensing unit (not shown).

The power supply unit 190 supplies power to the entire video display device 100. Particularly, it is possible to supply power to a control unit 170 that can be implemented in the form of a system on chip (SOC), a display unit 180 for displaying an image, and an audio output unit 185 for audio output .

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. Meanwhile, for example, when the display unit 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) that can perform a PWM operation for variable luminance or dimming driving is further provided It is possible.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote control apparatus 200 can receive the video, audio or data signal output from the user input interface unit 150 and display it on the remote control apparatus 200 or output sound or vibration.

The video display device 100 described above can be applied to digital broadcasting of the ATSC system (8-VSB system), digital broadcasting of the DVB-T system (COFDM system), digital broadcasting of the ISDB-T system (BST-OFDM system) And a digital broadcasting receiver capable of receiving at least one of the digital broadcasting signals.

The video display device described in the present specification is an image display device in which the display unit 180 and the audio output unit 185 shown in FIG. 2 are excluded. The video display device includes a display unit 180 and an audio output Or a wireless type for transmitting / receiving data to /

Meanwhile, a block diagram of the image display device 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the video display device 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

2, the video display device 100 may include a tuner 110 and a demodulator 120 shown in FIG. 2 and may include a network interface unit 130 or an external device interface unit 135 , It is possible to receive and reproduce the image contents.

3 is a view showing an apparatus capable of transmitting and receiving data with the video display device of FIG.

Referring to the drawings, an image display device 100 according to an embodiment of the present invention can communicate with a broadcasting station 210, a network server 220, or an external device 230.

The video display device 100 may receive a broadcasting signal including a video signal transmitted from the broadcasting station 210. The video display device 100 may process the video signal, the audio signal, or the data signal included in the broadcast signal so as to be suitable for output from the video display device 100. [ The video display device 100 can output video or audio based on the processed video signal.

Meanwhile, the video display device 100 can communicate with the network server 220. The network server 220 is a device capable of transmitting and receiving signals to and from the video display device 100 via an arbitrary network. For example, the network server 220 may be a mobile phone terminal that can be connected to the video display device 100 through a wired or wireless base station. In addition, the network server 220 may be a device capable of providing content to the video display device 100 through the Internet network. The content provider can provide the content to the video display device 100 using the network server.

On the other hand, the video display device 100 can communicate with the external device 230. The external device 230 is a device capable of transmitting and receiving signals directly to the image display device 100 by wire or wirelessly. For example, the external device 230 may be a media storage device or a playback device used by a user. That is, the external device 230 may be a camera, a DVD or Blu-ray player, a personal computer, or the like.

The broadcasting station 210, the network server 220, or the external device 230 can transmit a signal including a video signal to the video display device 100. [ The image display device 100 can display an image based on a video signal included in an input signal. The video display device 100 may transmit a signal transmitted from the broadcasting station 210 or the network server 220 to the video display device 100 to the external device 230. In addition, a signal transmitted from the external device 230 to the video display device 100 may be transmitted to the broadcasting station 210 or the network server 220. That is, the video display device 100 can transmit content included in the signals transmitted from the broadcasting station 210, the network server 220, and the external device 230, in addition to directly reproducing the video content from the video display device 100.

FIG. 4 is an internal block diagram of the control unit of FIG. 2. FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355 ), And a formatter 360. A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 135.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display unit 180.

The video decoder 325 can include a decoder of various standards.

For example, if the demultiplexed video signal is an MPEG-2 standard encoded video signal, it can be decoded by an MPEG-2 decoder.

Also, for example, if the demultiplexed video signal is an encoded video signal of the H.264 standard according to the DMB (Digital Multimedia Broadcasting) scheme or DVB-H, it can be decoded by the H.264 decoder.

Meanwhile, the video signal decoded by the video processor 320 is input to the mixer 350.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a user input signal or a control signal, a signal for displaying various information in graphic or text on the screen of the display unit 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon.

For example, the OSD generating unit 340 may generate a signal for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 220. The mixed signal is provided to formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

A frame rate converter (FRC) 355 can convert a frame rate of an input image. For example, a frame rate of 60 Hz is converted to 120 Hz or 240 Hz. When converting the frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame between the first frame and the second frame, or insert the third frame predicted from the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or insert three predicted frames. On the other hand, it is also possible to maintain the input frame rate without performing another conversion.

The formatter 360 receives the output signal of the frame rate conversion unit 355 and changes the format of the signal to be suitable for the display unit 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

When a demultiplexed speech signal is a coded speech signal, the speech processing unit (not shown) in the control unit 170 can decode the demultiplexed speech signal. For example, the demultiplexed speech signal may be decoded by an MPEG-2 decoder, an MPEG 4 decoder, an AAC decoder, or an AC-3 decoder.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme and may include DVB-SI information in the DVB scheme . The ATSC-PSIP information or DVB-SI information may be information included in the above-described stream, i.e., the header (4 bytes) of the MPEG-2 TS.

Meanwhile, the block diagram of the controller 170 shown in FIG. 4 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

5 to 6 are views showing various examples of the platform structure of the video display device of FIG.

The platform of the video display device 100 according to the embodiment of the present invention may include OS-based software to perform various operations as described above.

5, the platform of the video display device 100 according to another embodiment of the present invention is a separate platform. The legacy system platform 400 and the smart system platform 405 are separated from each other Can be designed. The OS kernel 410 can be commonly used in the legacy system platform 400 and the smart system platform 405.

The legacy system platform 400 may include a driver 420 on the OS kernel 410, a middleware 430, and an application layer 450.

On the other hand, the smart system platform 405 may include a library 435, a framework 440, and an application layer 455 on the OS kernel 410.

The OS kernel 410 is a core of an operating system and is used as a core of an operating system to drive a hardware driver, security of hardware and a processor in the video display device 100, efficient management of system resources, Management, provision of an interface to hardware by hardware abstraction, multi-process, and schedule management according to multi-process. Meanwhile, the OS kernel 410 may further provide power management and the like.

The hardware driver in the OS kernel 410 may include at least one of a display driver, a Wi-Fi driver, a Bluetooth driver, a USB driver, an audio driver, a Power management, a Binder driver, .

The hardware driver in the OS kernel 410 is a driver for a hardware device in the OS kernel 410 and includes a character device driver, a block device driver, and a network device driver dirver. Since a block device driver transfers data in units of specific blocks, a buffer for storing a unit size may be required. The character device driver may transmit a basic data unit, i.e., a character unit, so that a buffer may not be needed.

The OS kernel 410 may be implemented in various operating system (OS) based kernels such as UNIX based (Linux) and Windows based. The OS kernel 410 is an open OS kernel, and can be general-purpose which can be used in other electronic devices.

The driver 420 is located between the OS kernel 410 and the middleware 430 and drives the device along with the middleware 430 for operation of the application layer 450. For example, the driver 420 may include a microcomputer, a display module, a graphics processing unit (GPU), a frame rate conversion unit (FRC), a general purpose input / output pin (GPIO) A driver such as HDMI, SDEC (System Decoder or Demultiplexer), VDEC (Video Decoder), ADEC (Audio Decoder), PVR (Personal Video Recorder), or I2C (Inter-Integrated Circuit) . These drivers operate in conjunction with hardware drivers in the OS kernel 410. [

Further, the driver 420 may further include a remote control device 200, in particular, a driver for a space remote controller, which will be described later. In addition, the driver of the space remote controller may be variously provided in the OS kernel 410 or the middleware 430, in addition to the driver 420.

The middleware 430 is located between the OS kernel 410 and the application layer 450 and can serve as intermediary between other hardware or software to exchange data. Thus, it is possible to provide a standardized interface, various environment support, and system can interoperate with other tasks.

Examples of the middleware 430 in the legacy system platform 400 may be middleware of MHEG (Multimedia and Hypermedia information Coding Experts Group) and ACAP (Advanced Common Application Platform) which are data broadcasting related middleware. Or SI middleware, and peripheral communication related middleware DLNA middleware.

The application layer 450 on the middleware 430, that is, the application 450 layer in the legacy system platform 400, can be used to display, for example, a user interface application for various menus and the like in the video display device 100 . The application layer 450 on this middleware 430 may be editable by the user's choice and may be updated over the network. With this application layer 450, it is possible to enter a desired menu among various user interfaces according to the input of the remote control device 200 while watching the broadcast video.

The application layer 450 within the legacy system platform 400 may also include at least one of a TV guide application, a Bluetooth application, a reservation application, a Digital Video Recorder (DVR) application, .

Meanwhile, the library 435 in the smart system platform 405 is located between the OS kernel 410 and the framework 440, and can form the basis of the framework 440. For example, the library 435 may include a security related library such as Secure Socket Layer (SSL), WebKit (WebKit) related to Web engine, libc (c library), video format and audio format A media framework such as a media-related library, and the like. Such a library 435 may be written on a C or C ++ basis. It can also be exposed to the developer through the framework 440.

The library 435 may include a runtime 437 having a core Java library and a virtual machine (VM). This runtime 437 forms the basis of the framework 440 along with the library 435.

The virtual machine (VM) can be a plurality of instances, that is, a virtual machine that can perform multitasking. On the other hand, each virtual machine (VM) may be allocated and executed in accordance with each application in the application layer 455, at which time a binder (not shown) in the OS kernel 410, for scheduling or inter- Binder) driver (not shown) may be operated.

Meanwhile, the binder driver and the runtime 437 can connect a Java-based application and a C-based library.

On the other hand, the library 435 and the runtime 437 can correspond to the middleware of the legacy system.

On the other hand, the framework 440 in the smart system platform 405 includes a program that is the basis of the application in the application layer 455. The framework 440 is compatible with any application and may be capable of reusing, moving or exchanging components. The framework 440 may include a support program, a program for weaving other software components, and the like. For example, a resource manager, an activity manager associated with an activity of an application, a notification manager, a content provider that summarizes shared information between applications, and the like . Such a framework 440 can be created based on Java (JAVA).

The application layer 455 on the framework 440 includes various programs that can be displayed and driven in the video display device 100. [ For example, a Core Application having at least one of an email, a short message service (SMS), a calendar, a map, a browser, etc. . This application layer 450 may be created on a Java (JAVA) basis.

In addition, the application layer 455 includes an application 465 that is stored in the image display device 100 and can not be deleted by the user, an application 465 that is downloaded and stored through an external device or a network, 475).

(VOD) service, a web album service, a social networking service (SNS), a location-based service (LBS), a map service, a web search Service, an application search service, and the like may be performed. In addition, various functions such as game and schedule management can be performed.

6, the platform of the video display device 100 according to an embodiment of the present invention includes an OS kernel 510, a driver 520, a middleware 530, a framework 540, and an application layer 550. [

The platform of FIG. 6 differs from that of FIG. 5 in that the library 435 of FIG. 5 is omitted and the application layer 550 is provided as an integrated layer. In addition, the driver 520 and the framework 540 correspond to Fig.

On the other hand, the library 435 of FIG. 5 may be merged with the middleware 530. That is, the middleware 530 is middleware under the legacy system, middleware of MHEG or ACAP, middleware of PSIP or SI, middleware of broadcasting information, DLNA middleware which is middleware related to peripheral communication, Middleware under the device system can include SSL (Secure Socket Layer) which is a security related library, WebKit (WebKit) which is a web engine related library, libc, and a media framework which is a media related library. On the other hand, it may further include the above-described runtime.

The application layer 550 is an application under the legacy system that can include menu related applications, TV guide applications, reserved applications, etc. and can include email, SMS, calendars, maps, browsers, etc. have.

On the other hand, the application layer 550 includes an application 565 that is stored in the image display device 100 and can not be deleted by the user, an application 575 that is downloaded and stored through an external device or a network, .

The above-described platforms of Figs. 5 and 6 can be used for general purpose in various electronic apparatuses as well as video display apparatuses. 5 and 6 may be loaded in the storage unit 140 or the control unit 170 or a separate processor (not shown).

FIG. 7 is a diagram showing the operation of the remote control apparatus of FIG. 2. FIG.

Referring to the drawings, the remote control device 200 can transmit and receive signals in accordance with the RF communication standard or the IR communication standard with the image display device 100. [

FIG. 7A illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. FIG.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 7 (b)), and back and forth (Fig. 7 (c)). The pointer 205 displayed on the video display device 100 corresponds to the motion of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

7B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the video display device 100 moves to the left correspondingly. Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device 100. The image display device 100 can calculate the coordinates of the pointer 205 from information on the motion of the remote control device 200. [ The video display device 100 can display the pointer 205 so as to correspond to the calculated coordinates.

7C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is pressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed. On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control device 200 moves away from or approaches the display unit 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to a point on a horizontal axis or a vertical axis on the display unit 180 or may be displayed corresponding to a plurality of points such as a line or a surface Do.

8 is an internal block diagram of the remote control device of FIG.

The remote control device 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, And may include a control unit 280.

The wireless communication unit 225 transmits and receives signals to and from the video display device 100. In this embodiment, the remote control device 200 may include an RF module 221 that can transmit and receive signals to and from the image display device 100 according to the RF communication standard. Also, the remote control device 200 may include an IR module 223 capable of transmitting and receiving signals with the image display device 100 according to the IR communication standard.

In this embodiment, the remote control device 200 transmits a signal containing information on the motion of the remote control device 200 to the image display device 100 through the RF module 221. Also, the remote control device 200 can receive the signal transmitted by the video display device 100 through the RF module 221. [ Also, the remote control device 200 can transmit a command regarding power on / off, channel change, volume change, and the like to the image display device 100 through the IR module 223 as necessary.

The user input unit 235 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the image display device 100 to the remote control device 200 by operating the user input part 235. [ When the user input unit 235 has a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 235 has a touch screen, the user can touch a soft key of the touch screen to input a command related to the image display device 100 to the remote control device 200. [ In addition, the user input unit 235 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 can sense information on the motion of the remote control device 200. [ For example, the gyro sensor 241 can sense information on the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 243 can sense information on the moving speed of the remote control device 200 and the like. Meanwhile, a distance measuring sensor may be additionally provided, so that the distance to the display unit 180 can be sensed.

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the image display device 100. [ The user can recognize whether the user input unit 235 is operated or whether the video display device 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when a user input unit 235 is operated or a signal is transmitted and received between the image display device 100 and the image display device 100 through the wireless communication unit 225, 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce the power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives signals through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band Send and receive. The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving a signal with the image display device 100 paired with the remote control device 200 in the storage unit 270 Can be referenced.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240, (100).

FIG. 9 illustrates that a list of applications on the network is displayed on the display unit 180. FIG. That is, it is possible for the user to directly access the content server or the network server to search for and download various applications.

FIG. 9A illustrates that various application lists 910 in a connected server are displayed on the display unit 180. FIG. The application list 910 may include an icon representing each application and a brief description information for each application. On the other hand, in the video display device 100, since full browsing is possible, it is possible to enlarge and display the size of the icon or explanation information received from the connected server. Thus, the user can easily grasp the application item.

Next, FIG. 9 (b) illustrates the selection of any one of the application items 910 of the application list 910 by using the pointer 205 of the remote control device 200. FIG. As a result, the application can be easily downloaded.

On the other hand, Fig. 10 illustrates that an application list in the video display device is displayed on the display.

10A shows an application list 960 stored in the video display device 100 when the user enters the application list view item by the operation of the remote control device 200 by the display unit 180. [ As shown in Fig. In the drawing, only the icon representing each application is illustrated, but the present invention is not limited thereto, and may include brief explanatory information for each application, as shown in FIG. Thus, the user can easily grasp the application item.

Next, FIG. 10 (b) illustrates the selection of any one of the application items 970 of the application list 960 by using the pointer 205 of the remote control device 200. FIG. As a result, the application can be easily executed.

<Description of FIG. 11>

11 is a diagram for explaining an object search method displayed on a video display device according to an embodiment of the present invention. The video display device 1001 according to an embodiment of the present invention can transmit and receive signals to and from the image pattern server 1002 and the search engine or application providing server 1003. [ More specifically, the video display device 1001 can transmit and receive signals to and from the image pattern server 1002 and the search engine or application providing server 1003 using a wired or wireless Internet.

The video display device 1001 of the present embodiment can display a screen including at least one object on the display unit (S1005). In this embodiment, the object may include at least one of an icon, a widget, a menu, and a pointer that the image display device 1001 can display through the display unit. Also, in this embodiment, the object may include an object included in a screen that the image display device 1001 can display through the display unit. For example, the video display device 1001 that is reproducing content may include a character or a small object on the screen. In this case, the object includes objects that are separated from other characters or props such as a character or a props included in the screen and exist independently.

The user can input an object selection command included in the screen of the image display device 1001 to the image display device 1001. [ The video display device 1001 receives the object selection command (S1010). In this embodiment, the user of the video display device 1001 can input an object selection command to the video display device 1001 using the remote control device. For example, when the remote control device is a spatial remote controller, the image display device 1001 can display a pointer corresponding to the signal transmitted from the spatial remote controller on the screen. The signal transmitted from the spatial remote controller corresponds to the motion of the spatial remote controller. The user can move the spatial remote controller so that the movement trajectory of the pointer includes the predetermined object. In this case, the video display device 1001 determines that an object selection command included in the movement locus is input to the video display device 1001. [

In this embodiment, when at least two objects included in the movement trajectory are present, the image display device 1001 can determine that the object selection command displayed at the center of the movement trajectory is input. Also, the image display device 100 can determine that the object selection command most included in the movement trajectory is input.

The video display device 1001 selects a corresponding object according to the input selection command (S1015). In this case, the image display device 1001 can change at least one of the color, contrast, size, and border of the selected object. The user can confirm the selected object through the color, contrast, size, or border of the changed object.

The image display device 1001 transmits a signal including an image pattern of the selected object to the image pattern server 1002 (S1020). The image pattern server 1002 includes a database including information on image patterns of various objects. The image pattern server 1002 may query the database for an image pattern and search for keyword or attribute information corresponding to the image pattern (S1025).

In the present embodiment, when the content is being reproduced on the video display device 1001, the user can select a character corresponding to a character or an appearance item of the content being reproduced using a pointer. In this case, the video display device 1001 transmits to the image pattern server 1002 a signal including information about the image pattern of the character or the appearance item. Also, the video display device 1001 can transmit information about the content currently being played back to the image pattern server 1002 together with information on the image pattern.

The information about the content that the image display device 1001 can transmit to the image pattern server 1002 may include a content title, a person appearing in the content, a content plot, or the like currently playing back in the image display device 1001 . Also, when the content currently being reproduced by the video display device 1001 is content transmitted from the broadcasting station, the video display device 1001 can transmit the program information provided through the broadcasting station to the image pattern server 1002.

More specifically, the video display device 1001 according to an exemplary embodiment of the present invention may include content related information or EPG information (i.e., broadcast information) that is being reproduced in the video display device 1001 to search keyword or attribute information corresponding to the selected object And the like). The type of the detailed information that can be referred to by the video display device 1001 may include information on the genre, title, story, characters, characters, props, etc. of the broadcast video being reproduced in the current video display device. In addition, information on a genre, a content name, a summary information, an author, an editor, a character, a props, and the like of the content currently being played back on the video display device can be included.

When the image display device 1001 searches the keyword or attribute information by referring to information other than the image pattern as in the embodiment of the present invention, the keyword or attribute information more accurately corresponding to the object selected by the user can be searched. In addition, the time required for keyword or attribute information search can be reduced. For example, when the user selects an object corresponding to the wine bottle displayed by the image display device 1001, the image display device 1001 displays the image pattern of the object corresponding to the wine bottle and the additional information The keyword or attribute information can be searched with reference to the information corresponding to the small item of the information. If the additional information includes the product name of the small object appearing on the screen currently being played back, the video display device 1001 can search the keyword or attribute information corresponding to the object selected through the product name of the small object in addition to the image pattern .

The image pattern server 1002 queries the database for information about the image pattern included in the received signal. The image pattern server 1002 retrieves information corresponding to the queried image pattern among the information stored in the database. In the present embodiment, the information searched by the image pattern server 1002 is keyword or attribute information corresponding to the object selected by the video display device 1001. [ The image pattern server 1002 transmits the keyword or attribute information corresponding to the selected object to the image display device 1001 (S1030).

In this embodiment, the keyword transmitted from the image pattern server 1002 to the image display device 1001 may be the object name or the name of the selected object. In addition, the attribute information may be information on the type of object when the selected object is an object. As another example, the attribute information may be information on the occupation, nationality, sex, etc. of the person when the selected object is a person.

The image display device 1001 receives a signal transmitted by the image pattern server 1002. [ The video display device 1001 determines keyword or attribute information to be searched based on the received signal (S1035). The video display device 1001 queries the search engine or the application providing server 1003 for keyword or attribute information (S1040).

The search engine or application providing server 1003 can transmit and receive signals to / from the video display device 1001 via the wired or wireless Internet. A search engine is an engine for searching online information related to keyword or attribute information that is queried among information provided through the Internet. The application providing server 1003 is a server in which an application that can be installed and executed in the video display device 1001 is stored. The application providing server 1003 may search for information related to the application related to the keyword or attribute information that has been queried (S1045).

The search engine or application providing server 1003 may transmit a signal including the searched information to the video display device 1001 (S1050). The video display device 1001 displays the search result on the display unit based on the information included in the received signal (S1055). In this embodiment, the search result displayed by the video display device 1001 may be information retrieved through a search engine. In addition, the search result may be application-related information provided through the application providing server 1003.

12 &gt;

12 is a flow chart for explaining an object searching method displayed on an image display device according to an embodiment of the present invention.

The video display device 1011 according to an exemplary embodiment of the present invention displays a screen including at least one object on the display unit (S1105). Upon receiving the object selection command, the video display device 1011 selects an object corresponding to the selection command and outputs a signal including information on the image pattern of the selected object to the brokering server 1012 (S1110, S1115 , S1120).

The brokering server 1012 transmits to the image pattern server 1013 a signal including information on the image pattern of the object selected in the image display device 1011 or content related information being reproduced in the image display device 1011 S1125). In addition, the brokering server 1012 retrieves the information about the object matched with the image pattern by the image pattern server 1013 and receives the transmitted signal (S1130, S1135).

The brokering server 1012 determines keyword or attribute information to be searched based on the information included in the received signal, and queries the search engine or application providing server 1014 for keyword or attribute information (S1140, S1145). The search engine or application providing server 1014 searches the information corresponding to the query and transmits a signal including the searched information to the brokering server 1012 (S1150, S1155).

The broker server 1012 receives the signal transmitted from the search engine or the application providing server 1014 and transmits the search result to the image display device 1011 so that the search result is displayed on the image display device 1011. [ (S1160). The video display device 1011 displays the search result on the display unit based on the received signal (S1165).

In the present embodiment, the brokering server 1012 searches the keyword or attribute information of the selected object among the objects displayed on the video display device 1011. [ The brokering server 1012 transmits information about the image pattern of the selected object and content related information or broadcasting information currently being played back on the video display device 1011 to the image pattern server 1013 ). The image pattern server 1013 receives the keyword or attribute information corresponding to the selected object among the objects included in the screen displayed on the video display device 1011 based on the image pattern included in the signal transmitted from the broker server 1012 Search.

More specifically, the brokering server 1012 according to an exemplary embodiment of the present invention may include content related information or EPG information (i.e., broadcast information) that is being reproduced by the video display device 1011 in order to retrieve keywords or attribute information corresponding to the selected object And the like). The type of detailed information that can be referred to by the broker server 1012 may include information on a genre, a title, a plot, an appearance character, a production person, a props, and the like of a broadcast image being reproduced in a current image display device. In addition, information on a genre, a content name, a summary information, an author, an editor, a character, a props, and the like of the content currently being played back on the video display device can be included.

When the brokering server 1012 searches keyword or attribute information by referring to information other than the image pattern, the keyword or attribute information more accurately corresponding to the object selected by the user can be searched. In addition, the time required for keyword or attribute information search can be reduced. For example, when the user selects an object corresponding to the wine bottle displayed by the image display device 1011, the brokering server 1012 stores the image pattern of the object corresponding to the wine bottle and the additional information The keyword or attribute information can be searched with reference to the information corresponding to the small item of the information. If the additional information includes the product name of the props present on the screen currently being played back, the brokering server 1012 can search the keyword or the attribute information corresponding to the selected object through the product name of the props in addition to the image pattern .

The brokering server 1012 can determine keyword or attribute information corresponding to the object selected by the image display device 1011 based on the result retrieved from the image pattern server 1013. [ The brokering server 1012 queries the search engine or application providing server 1014 for the searched keyword or attribute information. The brokering server 1012 transmits a signal including information retrieved by the search engine or the application providing server 1014 to the image display device 1011 in response to the query.

The broker server 1012 according to the present embodiment is a device separated from the video display device 1011. The broker server 1012 is connected to the video display device 1011 through an external device that transmits video signals to the video display device 1011 or a broadcasting station that transmits video signals to the video display device 1011, It is possible to identify the content-related information that is being reproduced. Therefore, even when the video display device 1011 does not include an apparatus or algorithm for identifying the selected object, the video display device 1011 can search the selected object more accurately and simply through the brokering server 1012 .

13 to 16,

13 is a diagram for explaining a screen displayed on an image display device according to an embodiment of the present invention.

13A, the video display device 100 according to an exemplary embodiment of the present invention may display a content playback screen 1301 on the display unit. In the present embodiment, the content playback screen 1301 is a playback screen of movie content being played back through the video display device 100. [ More specifically, the content reproduction screen 1301 includes at least two objects 1311 and 1312. In the present embodiment, the first and second objects 1311 and 1312 included in the content reproduction screen 1301 are objects representing a person appearing in the content.

The user can input a command to the video display device 100 to select one of the first and second objects 1311 and 1312 included in the content playback screen 1301. [ In this embodiment, the user can input a selection command to the video display device 100 using the remote control device of the video display device 100. [ The video display device 100 can display a pointer corresponding to the signal transmitted from the remote control device on the screen.

13B is a view showing the video display device 100 in which the locus 1313 of the pointer moved corresponding to the signal transmitted from the remote control device is displayed. The user can operate the remote control device to include the object desired to be selected. In the present embodiment, the remote control device transmits a signal including information on the motion of the user to the image display device 100. [ The video display device 100 changes the display area of the pointer so as to correspond to the information included in the signal transmitted by the remote control device. The image display device 100 displays the movement trajectory 1313 of the pointer on the screen as the display area of the pointer is changed. In this embodiment, the object included in the movement trajectory 1313 is the second object 1312. [

14 is a diagram showing an example in which the image display device 100 changes the frame of the selected object. In the present embodiment, the image display device 100 can change at least one of the color, contrast, size, or border of the selected object so that the user can confirm that the object included in the movement trajectory is selected.

Further, in the video display device 100 of the present embodiment, when there are at least two or more objects included in the movement trajectory, one of them can be selected. More specifically, the image display device 100 can determine that an object displayed in the center of the movement trajectory of the objects included in the movement trajectory or an object included most in the movement trajectory is selected. The image display device 100 changes the display state of the object determined to be selected among the objects included in the movement trajectory.

As shown in FIG. 14A, the object included most in the objects included in the movement trajectory 1401 is an object 1402 representing the face of the content character. Therefore, the video display device 100 determines that the content character is selected. Further, the video display device 100 changes the border of the object 1402 representing the face of the content-appearing person to bold. Accordingly, the user can confirm that the object 1402 representing the content character is selected.

As shown in FIG. 14B, the object included in the moving trajectory 1403 is the object 1404 representing the costume worn by the content character. Accordingly, the video display device 100 determines that the clothes worn by the content characters are selected. Also, the image display device 100 changes the border of the object 1404 representing the costume worn by the content character to be thick. Accordingly, the user can confirm that the object 1404 representing the costume worn by the content character is selected.

Fig. 15 shows an example in which a search result of an object corresponding to a selected character among the objects included in the content screen is displayed, as shown in Fig. 14A.

As shown in FIG. 15, the video display device 100 can display information retrieved by the search engine in relation to the selected characters on the content reproduction screen 1501. More specifically, the video display device 100 can display the information retrieved by the search engine on the content reproduction screen 1501 through the pop-up window 1502. [

The video display device 100 according to an embodiment of the present invention can display search results corresponding to the selected object. For example, the video display device 100 according to an embodiment of the present invention can display a search result corresponding to a person appearing in the content as text through a pop-up window 1502 as shown in Fig. 15 . In addition, in the case of a search result corresponding to an object appearing in the content, the video display device 100 according to an embodiment of the present invention can display the content on the content playback screen through the image corresponding to the search result. The user can set a search result display format for each object in the video display device 100. [

16 is a diagram showing an example of displaying application-related information among search results corresponding to the selected object. As shown in FIG. 16A, the video display device 100 can display an icon 1602 corresponding to an application related to the selected object on the content playback screen 1601. In the present embodiment, the icon 1602 displayed on the content playback screen 1601 includes an icon that can execute the corresponding application, an icon that indicates the name of the corresponding application, an icon that indicates the function provided by the corresponding application, And may include at least one of icons representing excerpts of information to be provided.

16B shows a screen 1605 displayed on the video display device 100 when the icon 1603 selection command corresponding to the movie related application is input to the video display device 100 among the icons shown in FIG. It is a degree.

The video display device 100 displays a screen 1605 including the content playback video 1606 and the application execution video 1607 on the video display device 100. [ The application corresponding to the application execution image 1607 is an application related to the object selected by the user.

In this embodiment, the application executed by the video display device 100 is an application for providing movie related information. More specifically, the application executed by the video display device 100 provides information on the movie corresponding to the object 1608 selected by the user. In this embodiment, the object 1608 selected by the user is a character of the currently playing content. Thus, the application displays a list of movies in which the characters represented by the object 1608 appear, as shown in Fig. 16B.

The object search method, the image display apparatus and the system thereof displayed on the image display device according to the present invention are not limited to the configuration and method of the embodiments described above, but the embodiments may be modified variously All or some of the embodiments may be selectively combined.

Meanwhile, the operation method of the video display device of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the video display device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (18)

A method for searching an object by transmitting and receiving signals to and from a search engine through an image pattern server of an image display device,
Displaying a screen including at least one object on a display unit;
Displaying on the display unit a pointer corresponding to a signal transmitted by the remote control device of the video display device;
Receiving a selection command for selecting an object included in the movement trajectory when the pointer moves so that the movement trajectory of the pointer includes at least one or more objects included in the screen;
Selecting an object corresponding to the received selection command;
Changing at least one of a color, a lightness, a border and a size of the selected object;
Determining keyword or attribute information to be searched corresponding to the selected object;
Receiving application information retrieved in association with the keyword or attribute information or online information through the search engine; And
And displaying the search result on the display unit,
Wherein the keyword or attribute information determination step comprises:
Transmitting at least one of an image pattern of the selected object and content related information being reproduced in the image display device to the image pattern server providing information on the image pattern of the selected object;
Receiving keyword or attribute information corresponding to an image pattern of the selected object from the image pattern server; And
And determining the received keyword or attribute information as keyword or attribute information to be searched,
Wherein the object selecting step comprises:
Wherein the selecting unit selects an object displayed at the center of the moving trajectory or an object most included in the moving trajectory when the moving trajectory includes at least one object. delete The method according to claim 1,
Wherein the application or online information search step comprises:
Querying an application providing server or a search engine with application or online information corresponding to the keyword or attribute information; And
And receiving a signal including an application or online information provided by the application providing server or the search engine in response to the query. delete delete delete delete delete 1. An image display device for transmitting and receiving signals to and from an image pattern server and a search engine,
A display unit displaying a screen including at least one object;
A user input interface unit for receiving a signal transmitted from the remote control device; And
A pointer corresponding to a signal transmitted by the remote control device is displayed on the screen and when the pointer moves so that the movement trajectory of the pointer includes at least one or more objects included in the screen, , Selecting an object corresponding to the received selection command, changing at least one of a color, a lightness, a border, and a size of the selected object, and selecting the object corresponding to the selected object Determines application information to be searched in association with the keyword or attribute information or online information through the search engine,
And a control unit for controlling the display unit to display the search result,
Wherein,
Transmitting at least one of an image pattern of the selected object and content related information being reproduced by the image display device to the image pattern server providing information on the image pattern of the selected object,
Receiving keyword or attribute information corresponding to an image pattern of the selected object from the image pattern server,
And controls the received keyword or attribute information to be determined as keyword or attribute information to be searched corresponding to the selected object,
Wherein the controller controls to select an object displayed at the center of the movement trajectory or an object most included in the movement trajectory when the object includes at least one object included in the movement trajectory. delete 10. The method of claim 9,
Wherein the control unit queries a keyword or attribute information corresponding to at least one of the image pattern, the content-related information, or the EPG information to a server storing keyword or attribute information corresponding to the image pattern, And receives a signal including a keyword or attribute information transmitted by the server. 10. The method of claim 9,
Wherein the control unit queries the application providing server or the search engine for application or online information corresponding to the keyword or the attribute information and transmits a signal including application or online information provided by the application providing server or the search engine in response to the query To the display device. delete delete delete delete delete delete

Images