KR101877390B1 - Image display apparatus, and method for operating the same - Google Patents

Abstract

A method of operating an image display device in accordance with an embodiment of the present invention includes displaying an image on a display, displaying a smart advertisement icon on a display, receiving a selection input for a smart advertisement icon, Displaying a smart advertisement including a plurality of menu items.

Description

[0001] The present invention relates to an image display apparatus and a method of operating the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus and an operation method thereof, and more particularly, to an image display apparatus and an operation method thereof that can provide various and convenient advertisements and information.

A video display device is a device having a function of displaying an image that a user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

It is an object of the present invention to provide an image display apparatus and an operation method thereof that can provide various and convenient advertisements and information.

Another object of the present invention is to provide an image display apparatus and an operation method thereof that can improve the usability of the user.

According to another aspect of the present invention, there is provided a method of operating a video display device, the method comprising: displaying a video on a display; displaying a smart advertisement icon on a display; receiving a selection input on a smart advertisement icon; And displaying a smart advertisement including a plurality of menu items in at least some areas of the display.

According to another aspect of the present invention, there is provided a video display device including a display for displaying an image, a controller for controlling a smart advertisement icon to be displayed on a display, a user input for receiving a selection input for a smart advertisement icon, And the control unit controls the display unit to display a smart advertisement including a plurality of menu items in at least a part of the display based on the selection input.

According to the embodiment of the present invention, it is possible to provide advertisements and information in various and convenient ways, thereby improving the convenience of the user.

FIG. 1 is a schematic view of an image display apparatus system according to an embodiment of the present invention.
2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
3A and 3B are internal block diagrams of a set-top box and a display apparatus according to an embodiment of the present invention.
4 is a view showing an apparatus capable of transmitting and receiving data with the video display apparatus of FIG.
5 is an internal block diagram of the control unit of FIG.
6A and 6B are views showing various examples of the platform structure of the video display device of FIG.
7 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention.
FIGS. 8 to 21 are views referred to explain various examples of the operation method of the image display apparatus of FIG.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

Meanwhile, the video display device described in this specification is an intelligent video display device to which a computer-supporting function is added to a broadcast receiving function, and is equipped with an Internet function while being faithful to a broadcast receiving function, A 3D pointing device, and the like. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

That is, since various applications can be freely added or deleted on the general-purpose OS kernel, the video display device described in the present invention can perform various user-friendly functions. For example, it may be a smart TV.

FIG. 1 is a schematic view of an image display apparatus system according to an embodiment of the present invention.

Referring to the drawings, a video display device system according to an embodiment of the present invention includes a content provider (CP) 10, a service provider (SP) 20, a network provider (NP) 30, and a user 40.

The content provider 10 produces and provides various contents. 1, a terrestrial broadcaster, a cable SO (System Operator), a MSO (Multiple System Operator), a satellite broadcaster, an Internet broadcasting transmission Internet broadcaster and the like can be exemplified.

In addition, the content provider 10 may provide various applications in addition to the broadcast content.

The service provider 20 can provide the contents provided by the contents provider 10 in a service package. For example, the service provider 20 of FIG. 1 can package and provide the first terrestrial broadcast, second terrestrial broadcast, cable MSO, satellite broadcast, various Internet broadcasts, applications, etc. to the user.

Meanwhile, the service provider 20 can provide a service to the user 40 by using a unicast or multicast method. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in a unicast method, when a receiver requests data from a server, the server can transmit data to the receiver upon request. The multicast method is a method of transmitting data to a plurality of receivers of a specific group. For example, the server can transmit data to a plurality of pre-registered receivers at once. An Internet Group Management Protocol (IGMP) protocol may be used for multicast registration.

The network provider 30 may provide a network for providing services to the user 40. The user 40 may construct a home network end user (HNED) to receive a service.

Conditional access or content protection may be used as means for protecting contents transmitted in the video display device system. As an example of such restriction reception or content protection, a scheme such as a cable card (CableCARD) and a DCAS (Downloadable Conditional Access System) may be used.

On the other hand, the user 40 can also provide the content through the network. In this case, conversely, conversely, conversely, the user 40 may be a content provider and the content provider 10 may receive content from the user 40. [ Thereby enabling bidirectional content services or data services.

2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

2, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user input interface unit 150, A controller 180, a display 180, an audio output unit 185, and a power supply unit 190. [ The broadcast receiving unit 105 may include a tuner 110, a demodulating unit 120, and a network interface unit 130. The tuner 110 and the demodulator 120 may be selectively provided with the network interface unit 130.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it can be converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it can be converted into an analog baseband image or an audio signal (CVBS / SIF).

Meanwhile, the tuner 110 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 135 can connect the external device and the video display device 100. [ To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer , And may perform an input / output operation with an external device.

The A / V input / output unit can receive video and audio signals of external and external devices. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

On the other hand, the network interface unit 130 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received.

In addition, the network interface unit 130 can select and receive a desired application among applications open to the public via a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

The storage unit 140 may also function to temporarily store video, audio, or data signals input from the external device interface unit 135 or the network interface unit 130. In addition, the storage unit 140 may store information on a predetermined broadcast channel through the channel memory function.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 130. [

In addition, the storage unit 140 may store the platforms of Figs. 6A and 6B described later.

The video display apparatus 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

FIG. 2 illustrates an embodiment in which the storage unit 140 is provided separately from the controller 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

(Not shown), such as a power key, a channel key, a volume key, and a set value, from the remote control apparatus 200, (Not shown) that senses a user's gesture to the control unit 170 or transmits a signal from the control unit 170 to the control unit 170 It is possible to transmit it to the sensor unit (not shown).

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 135 to generate a signal for video or audio output Can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 2, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 according to a user command or an internal program input through the user input interface unit 150. In particular, the user can access a network and download a list of applications or applications desired by the user to the video display device 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The control unit 170 may output the video or audio signal processed by the user through the display 180 or the audio output unit 185 together with the channel information selected by the user.

For example, the control unit 170 may control the operation of the external device through the external device interface unit 135, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 150 So that a video signal or a voice signal of the display unit 180 or the audio output unit 185 can be output.

Meanwhile, the control unit 170 may control the display 180 to display an image. At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate a 3D object for a predetermined 2D object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

Such a 3D object may be processed to have a different depth than the image displayed on the display 180. [ Preferably, the 3D object may be processed to be projected relative to the image displayed on the display 180.

On the other hand, the control unit 170 can recognize the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

On the other hand, when entering the application viewing item, the control unit 170 can control to display a list of applications or applications that can be downloaded from the video display device 100 or from an external network.

The control unit 170 can control to install and drive an application downloaded from an external network, in addition to various user interfaces. In addition, at the user's selection, an image related to the executed application can be controlled to be displayed on the display 180. [

The control unit 170 can control to install and drive an application downloaded from an external network, in addition to various user interfaces. So that an image related to the executed application is displayed on the display 180. [

On the other hand, the control unit 170 can control to display an input window for inputting a search word. Such an input window may be displayed in an area different from the image displayed on the display 180, overlaid on the image, .

The display 180 converts the video signal, the data signal, the OSD signal processed by the control unit 170 or the video signal and the data signal received from the external device interface unit 135 into R, G, and B signals, respectively, Signal.

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may be a 3D display.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives the signal processed by the control unit 170 and outputs it as a voice.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. On the other hand, the photographing unit (not shown) may be embedded in the image display device 100 on the upper side of the display 180 or may be disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The control unit 170 can detect the gesture of the user based on each of the images photographed from the photographing unit (not shown) or the signals sensed from the sensor unit (not shown) or a combination thereof.

The power supply unit 190 supplies power to the entire image display apparatus 100. Particularly, it is possible to supply power to a control unit 170 that can be implemented in the form of a system on chip (SOC), a display 180 for displaying an image, and an audio output unit 185 for audio output have.

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. On the other hand, for example, when the display 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, it may further include an inverter (not shown) capable of PWM operation for variable luminance or dimming driving have.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control device 200 can use RF (Radio Frequency) communication, infrared (IR) communication, Bluetooth, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote control apparatus 200 can receive the video, audio or data signal output from the user input interface unit 150 and display it on the remote control apparatus 200 or output sound or vibration.

On the other hand, the remote control device 200 can transmit the coordinate information corresponding to the motion of the remote control device 200 to the video display device 100. [ Thus, a pointer corresponding to the motion of the remote control apparatus 200 can be displayed on the display of the image display apparatus. In this way, since the corresponding pointer is moved and displayed according to the movement in the 3D space, it can be called a 3D pointing device.

Meanwhile, the video display device 100 may be a digital broadcast receiver capable of receiving a fixed or mobile digital broadcast.

Meanwhile, the video display device described in the present specification can be applied to a TV set, a monitor, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (personal digital assistant), a portable multimedia player (PMP) And the like.

Meanwhile, a block diagram of the image display apparatus 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

2, the video display apparatus 100 does not include the tuner unit 110 and the demodulation unit 120 shown in FIG. 2, but may be connected to the network interface unit 130 or the external device interface unit 135 to play back the video content.

On the other hand, the video display device 100 is an example of a video signal processing device that performs signal processing of a video image or an input video image stored in the device. Other examples of the video signal processing apparatus may include a set-top box, a DVD player, a Blu-ray player, a game machine, a computer, and the like, except for the display 180 and the audio output unit 185 shown in FIG. have. The set-top box will be described with reference to FIGS. 3A to 3B below.

3A and 3B are internal block diagrams of a set-top box and a display apparatus according to an embodiment of the present invention.

3A, the set-top box 250 and the display device 300 can transmit or receive data by wire or wirelessly. Hereinafter, the difference from FIG. 2 will be mainly described.

The set top box 250 may include a network interface unit 255, a storage unit 258, a signal processing unit 260, a user input interface unit 263, and an external device interface unit 265.

The network interface unit 255 provides an interface for connection to a wired / wireless network including the Internet network. It can also transmit or receive data to other users or other electronic devices via the connected network or other network linked to the connected network.

The storage unit 258 may store a program for each signal processing and control in the signal processing unit 260 or may store a video, It may perform a function for temporary storage of a signal. In addition, the storage unit 258 may store the platforms of Figs. 6A and 6B, which will be described later.

The signal processing unit 260 performs signal processing of an input signal. For example, it is possible to demultiplex or decode an input video signal, and perform demultiplexing or decoding of an input audio signal. To this end, a video decoder or a voice decoder may be provided. The processed video signal or audio signal can be transmitted to the display device 300 through the external device interface unit 265. [

The user input interface unit 263 transfers a signal input by the user to the signal processing unit 260 or a signal from the signal processing unit 260 to the user. For example, various control signals, such as power on / off, operation input, and setting input, input through a local key (not shown) or the remote control device 200, may be received and transmitted to the signal processing unit 260.

The external device interface unit 265 provides an interface for transmitting or receiving data with an external device connected by wire or wirelessly. In particular, it provides an interface for transmitting or receiving data with the display device 300. It is also possible to provide an interface for data transmission or reception with an external device such as a game device, a camera, a camcorder, a computer (notebook computer) or the like.

The set-top box 250 may further include a media input unit (not shown) for playing a separate media. An example of such a media input unit is a Blu-ray input unit (not shown) or the like. That is, the set-top box 250 can include a Blu-ray player or the like. The input media such as a Blu-ray disc can be transmitted to the display device 300 via the external device interface 265 for display after signal processing such as demultiplexing or decoding in the signal processor 260 .

The display device 300 includes a broadcast receiving unit 272, an external device interface unit 273, a storage unit 278, a control unit 280, a user input interface unit 283, a display 290, 295).

The broadcast receiver 272 may include a tuner 270 and a demodulator 275.

The tuner 270, the demodulation unit 275, the storage unit 278, the control unit 280, the user input interface unit 283, the display unit 290, and the audio output unit 295, The display 180, and the audio output unit 185 of the tuner 110, the demodulation unit 120, the storage unit 140, the control unit 170, the user input interface unit 150, The description will be omitted.

On the other hand, the external device interface unit 273 provides an interface for data transmission or reception with an external device connected by wire or wirelessly. In particular, it provides an interface for transmitting or receiving data with the set-top box 250.

Accordingly, a video signal or a voice signal input through the set-top box 250 is output through the display unit 180 or the audio output unit 185 via the control unit 170.

Meanwhile, in connection with the embodiment of the present invention, the signal processor 260 controls to call a fixed boot image stored in a nonvolatile memory for displaying a home screen when the power is turned on. Here, the non-volatile memory may be the storage unit 258. [ Then, it can control to call the dynamic boot image from the network server, which is received through the network interface unit 255. Then, the fixed boot image and the dynamic boot image are combined to generate the final boot image. Then, the home screen image based on the generated final boot image may be transmitted to the display device 300 through the external device interface unit 265. The display apparatus 300 can control to display the generated home screen image on the display unit 290 via the external device interface unit 273 and the control unit 280. [

On the other hand, the set-top box 250 may receive only the dynamic boot image and transmit it to the display device 300. Accordingly, the display apparatus 300 can receive the dynamic boot image from the set-top box 250 and generate the final boot image in the control unit 280 using the dynamic boot image stored in the storage unit 2780 .

On the other hand, the set-top box 250 may transmit the received dynamic boot image and the fixed boot image stored in the storage unit 258 to the display apparatus 300. Thereby, the control unit 280 of the display apparatus 300 can generate the final boot image using the dynamic boot image and the fixed boot image.

3B, the set-top box 250 and the display device 300 are the same as the set-top box 250 and the display device 300 of FIG. 3A except that the broadcast receiver 272 is connected to the display device 300 is not located in the set-top box 250, but there is a difference therebetween. The broadcast receiving unit 272 further includes a network interface unit 255, which is different therefrom. Only the differences will be described below.

The signal processing unit 260 may perform signal processing of a broadcast signal received through the tuner 270 and the demodulation unit 275. Also, the user input interface unit 263 can receive inputs such as channel selection, channel storage, and the like.

Although the set-top box 250 shown in FIGS. 3A and 3B does not show the audio output unit 185 in FIG. 2, it is also possible to have separate audio output units.

4 is a view showing an apparatus capable of transmitting and receiving data with the video display apparatus of FIG.

Referring to the drawings, an image display apparatus 100 according to an embodiment of the present invention can communicate with a broadcasting station 210, a network server 220, or an external device 230.

The image display apparatus 100 may receive a broadcasting signal including a video signal transmitted from the broadcasting station 210. The image display apparatus 100 may process a video signal, a voice signal, or a data signal included in the broadcast signal so as to be suitable for output from the image display apparatus 100. [ The video display device 100 can output video or audio based on the processed video signal.

On the other hand, the video display device 100 can communicate with the network server 220. The network server 220 is a device capable of transmitting and receiving signals to and from the video display device 100 through an arbitrary network.

For example, the network server 220 may be a mobile phone terminal that can be connected to the image display apparatus 100 through a wired or wireless base station. In addition, the network server 220 may be a device capable of providing content to the video display device 100 through the Internet network. The content provider can provide the content to the video display device 100 using the network server.

On the other hand, the image display apparatus 100 can communicate with the external apparatus 230. The external device 230 is a device capable of transmitting / receiving signals directly to / from the image display device 100 by wire or wirelessly. For example, the external device 230 may be a media storage device or a playback device used by a user. That is, the external device 230 may be a camera, a DVD or Blu-ray player, a personal computer, or the like.

The broadcasting station 210, the network server 220, and the external device 230 can transmit a signal including a video signal to the video display device 100. The image display apparatus 100 can display an image based on a video signal included in an input signal.

The image display apparatus 100 may transmit a signal transmitted from the broadcast station 210 or the network server 220 to the image display apparatus 100 to the external apparatus 230. In addition, a signal transmitted from the external device 230 to the video display device 100 may be transmitted to the broadcasting station 210 or the network server 220.

That is, the video display device 100 can transmit contents included in the signals transmitted from the broadcasting station 210, the network server 220, and the external device 230, in addition to the direct playback of the video display device 100.

5 is an internal block diagram of the control unit of FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355 ), And a formatter 360. A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 135.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 325 can include a decoder of various standards.

Meanwhile, the video signal decoded by the video processor 320 is input to the mixer 350.

The processor 330 may control the overall operation in the image display apparatus 100 or in the control unit 170. [ For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150. [

In addition, the processor 330 may perform data transfer control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a user input signal or a control signal, a signal for displaying various information in graphic or text on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon.

For example, the OSD generating unit 340 may generate a signal for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 220. The mixed signal is provided to formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

A frame rate converter (FRC) 355 can convert a frame rate of an input image. On the other hand, the frame rate converter 350 can output the frame rate without conversion.

The formatter 360 receives the output signal of the frame rate conversion unit 355 and changes the signal format so as to be suitable for the display 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the formatter 360 can change the format of the 3D image signal or convert the 2D image into the 3D image.

Although not shown in the drawing, it is also possible that a 3D processor (not shown) for 3-dimensional effect signal processing is further disposed after the formatter 360. The 3D processor (not shown) can process the brightness, tint, and color of the image signal to improve the 3D effect. For example, it is possible to perform signal processing such as making the near field clear and the far field blurring. On the other hand, the functions of such a 3D processor can be merged into the formatter 360 or merged into the image processing unit 320. [

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

Meanwhile, the block diagram of the controller 170 shown in FIG. 5 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be separately provided.

6A and 6B are views showing various examples of the platform structure of the video display device of FIG.

The platform of the video display device 100 according to the embodiment of the present invention may include OS-based software to perform various operations as described above.

6A, the platform of the video display device 100 according to another embodiment of the present invention is a detachable platform, in which a legacy system platform 400 and a smart system platform 405 are separated from each other Can be designed. The OS kernel 410 can be commonly used in the legacy system platform 400 and the smart system platform 405.

The legacy system platform 400 may include a driver 420 on the OS kernel 410, a middleware 430, an application layer 450, and a smart system platform 405, A library 435 on the OS kernel 410, a framework 440, and an application layer 455. [

The OS kernel 410 is a core of an operating system and can be used to drive hardware drivers, security of hardware and a processor in the video display device 100, efficient management of system resources, Management, provision of an interface to hardware by hardware abstraction, multi-process, and schedule management according to multi-process. Meanwhile, the OS kernel 410 may further provide power management and the like.

The hardware driver in the OS kernel 410 may include at least one of a display driver, a Wi-Fi driver, a Bluetooth driver, a USB driver, an audio driver, a Power management, a Binder driver, .

The hardware driver in the OS kernel 410 is a driver for a hardware device in the OS kernel 410 and includes a character device driver, a block device driver, and a network device driver dirver. Since a block device driver transfers data in units of specific blocks, a buffer for storing a unit size may be required. The character device driver may transmit a basic data unit, i.e., a character unit, so that a buffer may not be needed.

The OS kernel 410 may be implemented in various operating system (OS) based kernels such as UNIX based (Linux) and Windows based. The OS kernel 410 is an open OS kernel, and can be general-purpose which can be used in other electronic devices.

The driver 420 is located between the OS kernel 410 and the middleware 430 and drives the device along with the middleware 430 for operation of the application layer 450. For example, the driver 420 may include a microcomputer, a display module, a graphics processing unit (GPU), a frame rate conversion unit (FRC), a general purpose input / output pin (GPIO) A driver such as HDMI, SDEC (System Decoder or Demultiplexer), VDEC (Video Decoder), ADEC (Audio Decoder), PVR (Personal Video Recorder), or I2C (Inter-Integrated Circuit) . These drivers operate in conjunction with hardware drivers in the OS kernel 410. [

In addition, the driver 420 may further include a driver for the remote control device 200, in particular, a 3D pointing device, which will be described later. The 3D pointing device driver may be variously provided in the OS kernel 410 or the middleware 430 in addition to the driver 420. [

The middleware 430 is located between the OS kernel 410 and the application layer 450 and can serve as intermediary between other hardware or software to exchange data. Thus, it is possible to provide a standardized interface, various environment support, and system can interoperate with other tasks.

Examples of the middleware 430 in the legacy system platform 400 may be middleware of MHEG (Multimedia and Hypermedia information Coding Experts Group) and ACAP (Advanced Common Application Platform) which are data broadcasting related middleware. Or SI middleware, and peripheral communication related middleware DLNA middleware.

The application layer 450 on the middleware 430, that is, the application 450 layer in the legacy system platform 400 can be configured to display, for example, a user interface application for various menus and the like in the video display device 100 . The application layer 450 on this middleware 430 may be editable by the user's choice and may be updated over the network. With this application layer 450, it is possible to enter a desired menu among various user interfaces according to the input of the remote control device 200 while watching the broadcast video.

The application layer 450 within the legacy system platform 400 may also include at least one of a TV guide application, a Bluetooth application, a reservation application, a Digital Video Recorder (DVR) application, .

Meanwhile, the library 435 in the smart system platform 405 is located between the OS kernel 410 and the framework 440, and can form the basis of the framework 440. For example, the library 435 may include a security related library such as Secure Socket Layer (SSL), WebKit (WebKit) related to Web engine, libc (c library), video format and audio format A media framework such as a media-related library, and the like. Such a library 435 may be written on a C or C ++ basis. It can also be exposed to the developer through the framework 440.

The library 435 may include a runtime 437 having a core Java library and a virtual machine (VM). This runtime 437 forms the basis of the framework 440 along with the library 435.

The virtual machine (VM) can be a plurality of instances, that is, a virtual machine that can perform multitasking. On the other hand, each virtual machine (VM) may be allocated and executed in accordance with each application in the application layer 455, at which time a binder (not shown) in the OS kernel 410, for scheduling or inter- Binder) driver (not shown) may be operated.

Meanwhile, the binder driver and the runtime 437 can connect a Java-based application and a C-based library.

On the other hand, the library 435 and the runtime 437 can correspond to the middleware of the legacy system.

On the other hand, the framework 440 in the smart system platform 405 includes a program that is the basis of the application in the application layer 455. The framework 440 is compatible with any application and may be capable of reusing, moving or exchanging components. The framework 440 may include a support program, a program for weaving other software components, and the like. For example, a resource manager, an activity manager associated with an activity of an application, a notification manager, a content provider that summarizes shared information between applications, and the like . Such a framework 440 can be created based on Java (JAVA).

The application layer 455 on the framework 440 includes various programs that can be displayed and driven in the video display device 100. [ For example, a Core Application having at least one of an email, a short message service (SMS), a calendar, a map, a browser, etc. . This application layer 450 may be created on a Java (JAVA) basis.

In addition, the application layer 455 includes an application 465 that is stored in the image display device 100 and can not be deleted by a user, an application 465 that is downloaded and stored through an external device or a network, 475).

(VOD) service, a web album service, a social networking service (SNS), a location-based service (LBS), a map service, a web search Service, an application search service, and the like may be performed. In addition, various functions such as game and schedule management can be performed.

6B, the platform of the video display device 100 according to one embodiment of the present invention is an integrated platform including an OS kernel 510, a driver 520, a middleware 530 ), A framework 540, and an application layer 550.

The platform of FIG. 6B differs from FIG. 6A in that the library 435 of FIG. 6A is omitted and the application layer 550 is provided as an integrated layer. In addition, the driver 520 and the framework 540 correspond to Fig. 6A.

On the other hand, the library 435 of FIG. 6A may be merged into the middleware 530. That is, the middleware 530 is middleware under the legacy system, middleware of MHEG or ACAP, middleware of PSIP or SI, middleware of broadcasting information, DLNA middleware which is middleware related to peripheral communication, Middleware under the device system can include SSL (Secure Socket Layer) which is a security related library, WebKit (WebKit) which is a web engine related library, libc, and a media framework which is a media related library. On the other hand, it may further include the above-described runtime.

The application layer 550 is an application under the legacy system that can include menu related applications, TV guide applications, reservation applications, etc. and can include email, SMS, calendar, map, browser, have.

On the other hand, the application layer 550 includes an application 565 that is stored in the image display device 100 and can not be deleted by the user, an application 565 that is downloaded and stored through an external device or a network, 575).

The platforms of FIGS. 6A and 6B described above can be used for general purpose in various electronic apparatuses as well as video display apparatuses.

6A and 6B may be loaded in the storage unit 140 or the control unit 170 or a separate processor (not shown).

FIG. 7 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention, and FIGS. 8 to 21 are referred to for explaining various examples of an operation method of the image display apparatus of FIG.

Referring to FIG. 8, a predetermined image 810 is displayed on a display 180 (S710)

The image 810 may be based on a signal received through the tuner 110, the network interface 130, or a signal received from an external device via the external device interface 135. [

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals via the tuner 110, the demodulation unit 120, the network interface unit 130, and the external device interface unit 135, It is possible to generate and output signals for video or audio output.

If the image 810 includes advertisement information or the image 810 is an advertisement image (S720), the controller 170 displays the smart advertisement icon 910 on the display 180 (S730). ≪ RTI ID = 0.0 >

According to an embodiment of the present invention, a watermark embedded in stream data or an advertisement identification information embedded in a metadata format at the time of image encoding is checked by a content provider to provide the following smart advertisement service .

In addition, an embodiment of the present invention may further include extracting a watermark or metadata included in the image data.

According to an embodiment of the present invention, the method may further include determining whether the image is an advertisement image, wherein the advertisement image determination step extracts a watermark or metadata included in the image data, Or not.

A recognition technique of various methods can be used for recognizing the advertisement image. For example, the image display apparatus can extract a sample image for several seconds and store it, and analyze the sample image to determine whether the image is an advertisement image.

Alternatively, a watermark included in the stream data may be checked by a content provider such as an advertisement to determine whether the advertisement image is displayed. After the signal is frequency-converted through FFT and DCT, a watermark can be given to the frequency component. For example, after the image is DCT, a watermark may be embedded in a frequency component using a spectrum technique, a PN code may be used as a watermark, and a spread spectrum technique may be used. Alternatively, a watermark may be embedded using a JPEG compression process or using a wavelet transform.

Alternatively, the advertisement recognition information may be inserted into the metadata format when the advertisement image is encoded, and the advertisement recognition information may be managed by the server or the network. The metadata may simply be implemented in the form of an XML text file. The image display device or the like can identify the advertisement image by checking the advertisement recognition information.

In addition, the above-described examples can be applied variously. For example, the advertisement recognition information may be embedded in the MPEG2 video user data area in the case of real-time broadcasting in the form of a closed caption, and in the case of external input, the advertisement identification watermark may be inserted in the advertisement production.

As described above, in the present specification, 'advertisement image' may mean an image including advertisement recognition information in addition to a conventional CF image.

For example, the predetermined image 810 shown in FIG. 8 may be a typical advertisement image for advertising the fragrance, or may be a video image or the like in which the advertisement recognition information of the perfume product is inserted into the content such as a drama or a movie have.

On the other hand, such advertisement recognition information can be provided regardless of a specific scene of the contents. For example, a smart advertisement icon regarding a piece dressed by a female protagonist of a drama may be provided not only in a scene where a heroine appears in the dress, but also during a time when a drama is being broadcasted.

The control unit 170 may receive a selection input for the smart advertisement icon 910 through the user input interface unit 150 and the control unit 170 may receive the selection input for the smart advertisement icon 910 from the display 180 based on the selection input. It is possible to control to display a smart advertisement including a plurality of menu items in at least some areas (S750)

The smart advertisement includes a shopping item for purchasing an article related to the advertisement image, an application item for downloading an application related to the advertisement image, a video item for reproducing a video related to the advertisement image, A catalog item including a list of other purchasable products, a social network service (SNS) item, and a history item that can display past smart advertisement items at least One can be included.

FIGS. 10A and 10B show examples of the smart advertisement screen.

Referring to the drawings, a smart advertisement screen includes an image area 1010 in which images are displayed, a product area 1020 in which selected products and related information can be displayed, and a smart advertisement area 1030 in which a plurality of smart advertisement items are displayed Can be divided and displayed.

A moving image or a still image may be displayed in the image area 1010.

For example, when the selection input is received, the advertisement image may be captured and displayed on the image region 1010 as a still image.

Since most of the advertisement images displayed on the image display device are as short as 20 to 30 seconds, it may be difficult to distinguish which advertisement is the smart advertisement service if the user goes through the next image.

Accordingly, by displaying the advertisement image at the time of receiving the selection input as an image, the user can intuitively grasp whether or not the advertisement is a smart advertisement related to the desired product.

Alternatively, upon receipt of the selection input, an image associated with the advertisement image may be displayed in the image region 1010. The image associated with the advertisement image may be the advertisement image itself, the same product, or an image of the same company.

According to an embodiment of the present invention, the method may further include reducing an area in which the advertisement image is displayed.

On the other hand, the number, type, display size, etc. of the items included in the smart advertisement area 1030 may vary. For example, it can be manually set as a setting input of a user, or can be automatically sorted and displayed in the order of items frequently used by the user.

10A, a shopping item 1031 for purchasing an article related to the advertisement image in the smart advertisement area 1030, an application item 1032 for downloading an application related to the advertisement image, a video related to the advertisement image, A map item 1034 including geographical information of a store related to the advertisement image, a catalog item 1035 including a list of other purchasable products, a product and advertisement A like item 1036 capable of evaluating the like is exemplified.

10B, a shopping item 1031 for purchasing an article related to the advertisement image in the smart advertisement area 1030, an application item 1032 for downloading an application related to the advertisement image, a video related to the advertisement image, A map item 1034 including geographical information of a store related to the advertisement image, a history item 1037 displaying past smart advertisement items, An SNS item 1038 that can be uploaded to the social network service with respect to the advertisement is illustrated.

On the other hand, when one of the menus is selected, a screen based on the selected item can be switched. In this case, some or all of the screens may be switched according to the menu.

11 to 18 are diagrams showing various examples of screens switched according to a selected menu item.

11A to 11D are views showing an example of a purchasing process.

10A and 10B, when a user selects a shopping item 1031 that can purchase an article related to an advertisement image, a part of the screen can be first switched as shown in FIG. 11A. Alternatively, unlike FIG. 11A, the entire screen may be switched.

Referring to the drawings, an advertisement related image 1110 and selected product related information 1120 are displayed in a partial area of the display 180, and a menu 'Buy Now' 1131 and a price And the like are displayed.

When the user selects the menu 1131 for purchase, at least a part of the screen can be switched to the payment screen 1140 including the input window 1141 for inputting the payment information and the confirmation menu 1142. [

Other delivery confirmation 1150, purchase complete message 1160, and the like may be displayed according to the embodiment.

12 shows an example in which at least a partial area 1210 of the screen is switched and displayed when the application item 1032 is selected.

Although FIG. 12 shows an example in which one confirmation is required for installation of the related application, the user can enter the mode for installing the related application directly.

In addition, a list of related applications may be displayed when there are a plurality of related applications.

FIG. 13 shows an example of a case where a video item 1033 capable of reproducing a video related to the advertisement image is selected, and is divided into an image area 1310 and a menu area 1320 for image reproduction, The menu area 1320 can be displayed overlapping with the image area 1310 for a predetermined time.

In addition, if there are a plurality of related images, a plurality of related images can be displayed in a list or a thumbnail form.

FIG. 14 shows examples of a case where a map item 1034 including geographical information of a shop related to the advertisement image is selected.

A shop associated with the advertisement image may display one store nearest to the map 1410 or all the stores within a predetermined distance.

FIG. 15 shows a case where a catalog item 1035 is selected, and a list of products 1510, 1520, 1530, and 1540 that can be purchased on the full screen 1500 may be displayed.

In addition, the display states of the selected product 1510 and the remaining products 1520, 1530, and 1540 may be different from each other, and the purchase menu 1550 of the selected product 1510 and the page switching object 1560) may be displayed.

Figures 16 and 17 illustrate the case where the likes 1036 and the SNS items 1038 are selected, respectively, so that the two items 1036 and 1038 perform similar operations and can be merged into one item.

On the other hand, if the likesection 1036 is selected, a menu 1610 for inputting a comment to be entered for an ID, a password, and a product may be displayed. On the other hand, if the user is already logged in with a predetermined account, input of an ID and a password may be unnecessary.

Also, when the SNS item 1038 is selected, a menu for selecting an SNS to be used among a plurality of SNS services may be displayed, or a menu and an input window 1710 for uploading to a default SNS may be displayed .

According to an embodiment of the present invention, the method may further include storing the smart advertisement, and thereafter displaying the entire list of stored smart advertisements or a list of smart advertisements selected by the user among the stored smart advertisements can do.

The view command of the stored smart advertisement can be performed by selecting the above history item 1037 or by inputting a separate key of the remote control device.

When the stored smart advertisement viewing command is input, a screen having the same structure as the smart advertisement screen may be displayed in the image area 1810, the information area 1820, and the smart advertisement list area 1830 as shown in FIG.

In the smart advertisement list area 1830, the past smart advertisements 1831, 1832, 1833, 1834, and 1835 are listed. If any one smart advertisement is selected, the corresponding smart advertisement screen can be switched as shown in FIG. .

19 and 20 show a signal flow between an image display apparatus and a server according to embodiments of the present invention.

Referring to FIG. 19, the image display apparatus 100 determines whether the displayed image is an advertisement image (S1910). If the image is an advertisement image, the address information of the content included in the smart advertisement menu is divided into a first And requests the server 610 (S1920)

Here, the address information of the content may be URL information of a server providing services required to provide a smart advertisement, and address information capable of obtaining metadata of contents.

The image display apparatus 100 receives the address information from the first server 610. In operation S1930,

Then, the smart advertisement icon is displayed (S1940), and the smart advertisement icon selection input of the user is received (S9150)

Upon receipt of the selection input, the video display apparatus 100 requests the second server 620 for data corresponding to the content included in the smart advertisement menu, and then transmits the data from the second server 620 to the second server 620 (S1970)

Here, the data corresponding to the content may be metadata for providing the actual service and the content.

Referring to FIG. 20, the video display device 100 recognizes advertisement recognition information such as a watermark, metadata, and the like to determine whether the displayed video is an advertisement video (S2010 )

If the image is an advertisement image, the image display apparatus 100 requests the third server 630 to provide data corresponding to the content included in the smart advertisement menu (S2020)

Meanwhile, the third server 630 is a server having a database for a smart advertisement service. When the video display device recognizes and transmits advertisement recognition information such as watermark and metadata, the third server 630 displays a shopping, application, video, (S2030), and transmits the extracted metadata to the image display apparatus 100 (S2040)

That is, in this case, the third server 630 may hold or invoke all necessary data such as metadata that can provide the service.

The image display apparatus 100 receives the data and displays a smart advertisement icon in step S2040.

After receiving the smart advertisement icon selection input of the user (S2060), the smart advertisement service is provided to the user (S2070)

According to an embodiment of the present invention, the method further includes displaying an exit item 2110 for ending the menu, i.e., the Smart advertisement, as shown in FIG. 21, wherein the user selects the exit item 2110, If there is no time input, you can switch back to the broadcast screen. Alternatively, the screen may be activated by a separate cancel or exit key input of the remote control device.

According to the embodiment of the present invention, it is possible to provide advertisements and information in various and convenient ways, thereby improving the convenience of the user.

The image display apparatus and the operation method thereof according to the present invention are not limited to the configuration and method of the embodiments described above, but the embodiments may be applied to all or some of the embodiments May be selectively combined.

Meanwhile, the operation method of the image display apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (17)

Displaying an image on a display;
Extracting a watermark or metadata included in the image data to determine whether the image is an advertisement image;
Displaying a smart advertisement icon associated with the advertisement image on a partial area of the display when the image is determined as the advertisement image;
Receiving a selection input for the smart advertisement icon;
And displaying a smart advertisement including a plurality of smart advertisement menu items in at least some areas of the display. delete The method according to claim 1,
Requesting address information of content included in the smart advertisement menu; And
And receiving the address information. ≪ Desc / Clms Page number 21 > The method according to claim 1,
Requesting data corresponding to content included in the smart advertisement menu; And
And receiving data corresponding to contents included in the smart advertisement menu The method according to claim 1,
The smart advertisement includes a shopping item for purchasing an article related to the advertisement image, an application item for downloading an application related to the advertisement image, a video item for reproducing a video related to the advertisement image, A catalog item including a list of other purchasable products, a social network service (SNS) item, and a history item that can display past smart advertisement items at least The method comprising the steps of: The method according to claim 1,
Capturing the displayed image and displaying the captured image as a still image upon receiving the selection input. The method according to claim 1,
And displaying an image associated with the displayed image upon receiving the selection input. The method according to claim 1,
And reducing the area in which the image is displayed. The method according to claim 1,
And switching to a screen based on the selected item when one of the plurality of smart advertisement menu items is selected. The method according to claim 1,
Storing the smart advertisement; And
And displaying a list of the stored smart advertisements or a list of smart advertisements selected by the user among the stored smart advertisements.


delete delete delete delete delete delete delete

Images