KR102444150B1 - Image display apparatus - Google Patents

Abstract

The present invention relates to an image display device. An image display device according to an embodiment of the present invention includes a display, an interface unit for exchanging data with a mobile terminal, and a mirroring-related menu including mirroring-related server information or content related to server information based on a user input. and a control unit for controlling to display, receiving a mirroring application item from the mobile terminal through the interface unit, and controlling the received mirroring application item to be displayed in the mirroring related menu. Thereby, it is possible to easily install and display the mirroring application item from the mobile terminal.

Description

Image display apparatus

The present invention relates to an image display device, and more particularly, to an image display device capable of easily installing and displaying a mirroring application item from a mobile terminal.

An image display device is a device having a function of providing an image that a user can watch. The user can watch the broadcast through the image display device. The video display device provides a broadcast selected by a user among broadcast signals transmitted from a broadcast station, and the broadcast video is displayed on a display. Currently, the trend of broadcasting worldwide is converting from analog broadcasting to digital broadcasting.

Digital broadcasting refers to broadcasting that transmits digital image and audio signals. Compared to analog broadcasting, digital broadcasting is strong against external noise, so data loss is small, it is advantageous for error correction, and provides a high resolution and clear screen. Also, unlike analog broadcasting, digital broadcasting can provide interactive services.

An object of the present invention is to provide an image display device that can easily install and display a mirroring application item from a mobile terminal.

Another object of the present invention is to provide an image display device capable of easily performing mirroring between a mobile terminal and an image display device.

An image display device according to an embodiment of the present invention for achieving the above object includes a display, an interface unit for exchanging data with a mobile terminal, and based on a user input, mirroring-related server information or content related to server information Control to display a mirroring related menu, including, a mirroring application item from the mobile terminal, through the interface unit, and includes a control unit for controlling to display the received mirroring application item, the mirroring related menu.

In addition, the image display device according to another embodiment of the present invention for achieving the above object, a display, an interface unit for exchanging data with a mobile terminal, and based on a user input, control to display a mirroring related menu, When the first mirroring application item in the mirroring related menu is selected, control to transmit a pairing request signal to the mobile terminal, and through the interface unit, the first mirroring application image, from the mobile terminal, is received, the first mirroring application received It includes a control unit for controlling to display the image.

In addition, an image display device according to another embodiment of the present invention for achieving the above object, based on a display, an interface unit for exchanging data with a mobile terminal, and a user input, displays a mirroring related menu or mirroring item control to transmit a pairing request signal to the mobile terminal corresponding to the first user, when the first user item in the mirroring related menu or mirroring item is selected, and through the interface unit, the first mirroring application image, 1 receives from the mobile terminal of the user, and includes a control unit for controlling to display the received first mirroring application image.

According to an embodiment of the present invention, an image display device includes a display, an interface unit for exchanging data with a mobile terminal, and a mirroring-related menu including mirroring-related server information or content related to server information based on a user input By including a control unit for controlling to display, receiving a mirroring application item from the mobile terminal, through the interface unit, and controlling the received mirroring application item to be displayed in the mirroring-related menu, the mirroring application item from the mobile terminal is conveniently can be installed and displayed.

In particular, by displaying a code image including server information as content related to server information, it is possible to induce a simple connection to a server through a mobile terminal.

On the other hand, when the first mirroring application item is selected among the mirroring application items displayed in the mirroring related menu, after pairing with the mobile terminal, the first mirroring application execution image is received from the mobile terminal, through the network interface unit, and received By displaying the first mirroring application execution image to be displayed on the display, it is possible to easily perform mirroring between the mobile terminal and the image display device.

On the other hand, according to another embodiment of the present invention, the image display device, the display, the interface unit for exchanging data with the mobile terminal, based on the user input, control to display the mirroring related menu, the mirroring related menu When the 1 mirroring application item is selected, control to transmit a pairing request signal to the mobile terminal, receive the first mirroring application image through the interface unit, from the mobile terminal, and control to display the received first mirroring application image By including a control unit, it is possible to easily perform mirroring between the mobile terminal and the image display device.

According to another embodiment of the present invention, an image display device includes a display, an interface unit for exchanging data with a mobile terminal, and controls to display a mirroring related menu or a mirroring item based on a user input, and a mirroring related menu Or, when the first user item in the mirroring item is selected, control to transmit a pairing request signal to the mobile terminal corresponding to the first user, and through the interface unit, receive the first mirroring application image, from the first user mobile terminal And, by including a control unit for controlling to display the received first mirroring application image, it is possible to easily perform mirroring between the mobile terminal and the image display device.

1 is a diagram illustrating an image display system for mirroring according to an embodiment of the present invention.
FIG. 2 is an example of an internal block diagram of the image display device of FIG. 1 .
FIG. 3 is an example of an internal block diagram of the control unit of FIG. 2 .
FIG. 4A is a diagram illustrating a control method of the remote control device of FIG. 2 .
4B is an internal block diagram of the remote control device of FIG. 2 .
FIG. 5 is an internal block diagram of the mobile terminal of FIG. 1 .
6 is a flowchart illustrating an example of a method of operating an image display device and a mobile terminal according to an embodiment of the present invention.
7A to 11C are diagrams referenced to explain the operation method of FIG. 6 .
12 is a flowchart illustrating an example of a method of operating an image display device and a mobile terminal according to another embodiment of the present invention.
13A to 14C are diagrams referenced to explain the operation method of FIG. 12 .
15 is a flowchart illustrating an example of a method of operating an image display device and a mobile terminal according to another embodiment of the present invention.
16A to 20F are diagrams referenced to explain the operation method of FIG. 15 .

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "part" for the components used in the following description are given simply in consideration of the ease of writing the present specification, and do not impart a particularly important meaning or role by themselves. Accordingly, the terms “module” and “unit” may be used interchangeably.

1 is a diagram illustrating an image display system for mirroring according to an embodiment of the present invention.

Referring to the drawings, the image display system 10 for mirroring may include an image display device 100 , a mobile terminal 600 , and a server 500 .

Among them, the image display device 100 and the mobile terminal 600 may perform mirroring.

In the present invention, for the convenience of mirroring between the image display device 100 and the mobile terminal 600, the mirroring application item from the mobile terminal 600, the image display device 100, easily installed and displayed suggest ways to do it.

To this end, the image display device 100 may display mirroring-related server information or a mirroring-related menu including content related to server information, based on a user input.

At this time, the mirroring-related server information or content related to the server information may be information provided by the manufacturer of the image display device 100 .

In addition, the mobile terminal 600 may receive mirroring-related server information or content related to server information displayed on the mirroring-related menu, and may access the server 500 based on this.

In addition, the mobile terminal 600 may receive, from the server 500 , a mirroring-related application, and install and execute a mirroring-related application in the mobile terminal 600 .

Then, the mobile terminal 600 may transmit the selected mirroring application item to the image display device when an application item to be mirrored is selected through the executed mirroring-related application.

And, the image display device 100, from the mobile terminal 600, a mirroring application item, through the interface unit 130 or 135, receive, and the received mirroring application item, can be displayed in the mirroring related menu .

Accordingly, it is possible to easily install and display the mirroring application item on the image display device 100 .

In addition, in the present invention, when the first mirroring application item is selected in the state where the mirroring application item from the mobile terminal 600 is installed and displayed on the image display device 100 , the first mirroring application execution image is conveniently A method for mirroring and displaying is presented.

To this end, the image display device 100 transmits pairing information or the first mirroring application execution request information to the mobile terminal 600 when the first mirroring application item is selected among the mirroring application items displayed in the mirroring related menu. And, from the mobile terminal 600, the first mirroring application execution image, through the network interface unit 130 or 135, it is possible to receive, and display the received first mirroring application execution image on the display 180.

On the other hand, in the drawing, by mirroring between the image display device 100 and the mobile terminal 600; a wireless signal Saib for the gallery image 840a for the gallery application executed in the mobile terminal 600 It is transmitted to the image display device 100 and exemplifies that an enlarged gallery image 840b corresponding to the gallery application is displayed on the image display device 100 .

Since the size of the display 180 of the image display device 100 is much larger than the size of the display (680 in FIG. 5) of the mobile terminal 600, the user can view the enlarged image through mirroring. .

As an example of such a method of performing mirroring, when a mirroring mode is selected in the image display apparatus 100 , the image display apparatus 100 wirelessly transmits a pairing signal to the mobile terminal 600 , and the mobile terminal The mobile terminal 600 and the image display apparatus 100 may be connected to each other by the 600 transmitting a pairing response signal in response to the pairing signal.

In this case, the pairing signal and the pairing response signal may be a Bluetooth-based BLE (Blooth Low Energy) signal.

In this case, the image display apparatus 100 may further transmit device information including a device ID to the mobile terminal 600 in addition to the pairing signal.

As another example of such a method of performing mirroring, when the mirroring mode is selected in the mobile terminal 600, the mobile terminal 600 wirelessly transmits a pairing signal to the image display device 100, and the image display device ( The mobile terminal 600 and the image display device 100 may connect to each other by transmitting a pairing response signal in response to the pairing signal 100 .

After the connection, the mobile terminal 600 may wirelessly transmit an application image related to mirroring being executed to the image display device 100 . For example, according to a Miracast method, an application image may be wirelessly transmitted to the image display device 100 through Wi-Fi.

Meanwhile, in the present invention, for the convenience of the user, the mirroring mode is performed centering on the image display device 100 .

Various operating methods of the above-described image display device 100 and the mobile terminal 600 will be described in more detail with reference to FIG. 6 or less.

Meanwhile, the image display device 100 of FIG. 1 may be a monitor, TV, tablet PC, or the like.

FIG. 2 is an example of an internal block diagram of the image display device of FIG. 1 .

Referring to FIG. 2 , the image display device 100 according to an embodiment of the present invention includes a broadcast receiving unit 105 , an external device interface unit 130 , a storage unit 140 , a user input interface unit 150 , It may include a sensor unit (not shown), a control unit 170 , a display 180 , and an audio output unit 185 .

The broadcast reception unit 105 may include a tuner unit 110 , a demodulator unit 120 , a network interface unit 130 , and an external device interface unit 135 .

Meanwhile, the broadcast receiver 105 may include only the tuner 110 , the demodulator 120 , and the external device interface 135 , unlike the drawing. That is, the network interface unit 130 may not be included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by a user or all channels previously stored among RF (Radio Frequency) broadcast signals received through an antenna (not shown). In addition, the selected RF broadcast signal is converted into an intermediate frequency signal or a baseband video or audio signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner unit 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS/SIF) output from the tuner unit 110 may be directly input to the control unit 170 .

Meanwhile, in the present invention, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna in the present invention, and converts them to an intermediate frequency signal or a baseband image or audio signal. can be converted to

Meanwhile, the tuner unit 110 may include a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulator 120 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal obtained by multiplexing an image signal, an audio signal, or a data signal.

The stream signal output from the demodulator 120 may be input to the controller 170 . After performing demultiplexing, image/audio signal processing, and the like, the controller 170 outputs an image to the display 180 , and outputs an audio to the audio output unit 185 .

The external device interface unit 130 may transmit or receive data to or from a connected external device (not shown), for example, the set-top box 50 . To this end, the external device interface unit 130 may include an A/V input/output unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, and the like by wire/wireless. , it is also possible to perform input/output operations with an external device.

The A/V input/output unit may receive video and audio signals from an external device. Meanwhile, the wireless communication unit (not shown) may perform short-range wireless communication with other electronic devices.

Through such a wireless communication unit (not shown), the external device interface unit 130 may exchange data with the adjacent mobile terminal 600 . In particular, the external device interface unit 130 may receive device information, executed application information, an application image, and the like, from the mobile terminal 600 in the mirroring mode.

The network interface unit 135 provides an interface for connecting the image display device 100 to a wired/wireless network including an Internet network. For example, the network interface unit 135 may receive content or data provided by the Internet, a content provider, or a network operator through a network.

Meanwhile, the network interface unit 135 may include a wireless communication unit (not shown).

The storage unit 140 may store a program for each signal processing and control in the control unit 170 , or may store a signal-processed image, audio, or data signal.

Also, the storage unit 140 may perform a function for temporarily storing an image, audio, or data signal input to the external device interface unit 130 . Also, the storage unit 140 may store information about a predetermined broadcast channel through a channel storage function such as a channel map.

Although the embodiment in which the storage unit 140 of FIG. 2 is provided separately from the control unit 170 is illustrated, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit 170 .

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or transmits a signal from the control unit 170 to the user.

For example, transmit/receive user input signals such as power on/off, channel selection, and screen setting from the remote control device 200, or local keys such as power key, channel key, volume key, and setting value (not shown) transmits a user input signal input to the control unit 170, transmits a user input signal input from a sensor unit (not shown) for sensing a user's gesture to the control unit 170, or transmits a signal from the control unit 170 It can be transmitted to a sensor unit (not shown).

The control unit 170 demultiplexes an input stream through the tuner unit 110 or the demodulator 120 , the network interface unit 135 or the external device interface unit 130 , or processes the demultiplexed signals. , can generate and output a signal for video or audio output.

The image signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the image signal. Also, the image signal processed by the controller 170 may be input to an external output device through the external device interface unit 130 .

The audio signal processed by the controller 170 may be outputted to the audio output unit 185 . Also, the audio signal processed by the controller 170 may be input to an external output device through the external device interface unit 130 .

Although not shown in FIG. 2 , the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 3 .

In addition, the controller 170 may control overall operations in the image display apparatus 100 . For example, the controller 170 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a pre-stored channel (tuning).

Also, the control unit 170 may control the image display apparatus 100 according to a user command input through the user input interface unit 150 or an internal program.

Meanwhile, the controller 170 may control the display 180 to display an image. In this case, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may cause a predetermined 2D object to be displayed in the image displayed on the display 180 . For example, the object may be at least one of an accessed web screen (newspaper, magazine, etc.), an electronic program guide (EPG), various menus, widgets, icons, still images, moving pictures, and text.

Meanwhile, the controller 170 may recognize the location of the user based on the image captured by the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 may be determined. In addition, an x-axis coordinate and a y-axis coordinate in the display 180 corresponding to the user's location may be identified.

The display 180 converts an image signal, a data signal, an OSD signal, a control signal, or an image signal, a data signal, and a control signal received from the external device interface unit 130 processed by the controller 170 to generate a driving signal. create

The display 180 may be a PDP, LCD, OLED, flexible display, or the like, and may also be a three-dimensional display (3D display). The 3D display 180 may be divided into a non-glasses type and a glasses type.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to an output device.

The audio output unit 185 receives the audio-processed signal from the control unit 170 and outputs it as audio.

The photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented with one camera, but is not limited thereto, and may be implemented with a plurality of cameras. Meanwhile, the photographing unit (not shown) may be embedded in the image display device 100 above the display 180 or disposed separately. Image information captured by the photographing unit (not shown) may be input to the control unit 170 .

The controller 170 may detect the user's gesture based on each or a combination of an image captured by a photographing unit (not shown) or a signal sensed from a sensor unit (not shown).

The power supply unit 190 supplies the corresponding power throughout the image display device 100 . In particular, it is possible to supply power to the control unit 170 that can be implemented in the form of a system on chip (SOC), the display 180 for displaying an image, and the audio output unit 185 for outputting audio. have.

Specifically, the power supply unit 190 may include a converter for converting AC power into DC power, and a dc/dc converter for converting the level of DC power.

The remote control device 200 transmits a user input to the user input interface unit 150 . To this end, the remote control device 200 may use Bluetooth (Bluetooth), radio frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like. In addition, the remote control device 200 may receive an image, audio, or data signal output from the user input interface unit 150 , and display it or output the audio signal from the remote control device 200 .

Meanwhile, the above-described image display apparatus 100 may be a digital broadcasting receiver capable of receiving fixed or mobile digital broadcasting.

Meanwhile, the block diagram of the image display device 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display device 100 that are actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed in each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

FIG. 3 is an example of an internal block diagram of the control unit of FIG. 2 .

Referring to the drawings, the controller 170 according to an embodiment of the present invention includes a demultiplexer 310 , an image processor 320 , a processor 330 , an OSD generator 340 , and a mixer 345 . , a frame rate converter 350 , and a formatter 360 . In addition, it may further include an audio processing unit (not shown) and a data processing unit (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when MPEG-2 TS is input, it can be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner unit 110 , the demodulator 120 , or the external device interface unit 130 .

The image processing unit 320 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 320 may include an image decoder 325 and a scaler 335 .

The image decoder 325 decodes the demultiplexed image signal, and the scaler 335 performs scaling to output the resolution of the decoded image signal on the display 180 .

The video decoder 325 may include decoders of various standards. For example, it may include an MPEG-2, H,264 decoder, a 3D image decoder for a color image and a depth image, a decoder for a multi-view image, and the like.

The processor 330 may control overall operations in the image display apparatus 100 or the controller 170 . For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a pre-stored channel.

Also, the processor 330 may control the image display apparatus 100 according to a user command input through the user input interface unit 150 or an internal program.

In addition, the processor 330 may perform data transmission control with the network interface unit 135 or the external device interface unit 130 .

Also, the processor 330 may control operations of the demultiplexer 310 , the image processor 320 , the OSD generator 340 , and the like in the controller 170 .

The OSD generator 340 generates an OSD signal according to a user input or by itself. For example, a signal for displaying various types of information as graphics or text on the screen of the display 180 may be generated based on a user input signal. The generated OSD signal may include various data such as a user interface screen of the image display device 100 , various menu screens, widgets, and icons. Also, the generated OSD signal may include a 2D object or a 3D object.

Also, the OSD generator 340 may generate a pointer that can be displayed on a display based on a pointing signal input from the remote control device 200 . In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generation unit 240 may include such a pointing signal processing unit (not shown). Of course, the pointing signal processing unit (not shown) may be provided separately instead of being provided in the OSD generating unit 240 .

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal image-processed by the image processor 320 . The mixed video signal is provided to the frame rate converter 350 .

A frame rate converter (FRC) 350 may convert a frame rate of an input image. On the other hand, the frame rate converter 350 may output as it is without a separate frame rate conversion.

The formatter 360 may arrange a left-eye image frame and a right-eye image frame of the frame rate-converted 3D image. In addition, a synchronization signal Vsync for opening the left eye glass and the right eye glass of the 3D viewing apparatus (not shown) may be output.

Meanwhile, the formatter 360 may change the format of the input image signal into an image signal for display on a display and output the changed format.

Also, the formatter 360 may change the format of the 3D image signal. For example, among various 3D formats such as Side by Side format, Top / Down format, Frame Sequential format, Interlaced format, Checker Box format, etc. You can change to either format.

Meanwhile, the formatter 360 may convert a 2D video signal into a 3D video signal. For example, according to a 3D image generation algorithm, an edge or a selectable object is detected in a 2D image signal, and an object or a selectable object according to the detected edge is separated into a 3D image signal. can In this case, as described above, the generated 3D image signal may be separated into a left-eye image signal L and a right-eye image signal R and arranged.

On the other hand, although not shown in the drawing, it is also possible that a 3D processor (not shown) for processing a 3D effect signal is further disposed after the formatter 360 . Such a 3D processor (not shown) may process brightness, tint, and color adjustment of an image signal to improve a 3D effect. For example, signal processing that makes a near field clear and a far distance blurry may be performed. Meanwhile, the functions of the 3D processor may be merged into the formatter 360 or integrated into the image processing unit 320 .

Meanwhile, an audio processing unit (not shown) in the controller 170 may perform audio processing of the demultiplexed audio signal. To this end, the audio processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 may process a base (Base), a treble (Treble), volume control, and the like.

A data processing unit (not shown) in the control unit 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be electronic program guide information including broadcast information such as start time and end time of a broadcast program aired on each channel.

Meanwhile, a block diagram of the control unit 170 shown in FIG. 3 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170 , but may be separately provided or provided separately as one module.

FIG. 4A is a diagram illustrating a control method of the remote control device of FIG. 2 .

As illustrated in (a) of FIG. 4A , it is exemplified that a pointer 205 corresponding to the remote control device 200 is displayed on the display 180 .

The user may move or rotate the remote control device 200 up and down, left and right (FIG. 4A (b)), and back and forth (FIG. 4A (c)). The pointer 205 displayed on the display 180 of the image display device corresponds to the movement of the remote control device 200 . As shown in the drawing, the remote control device 200 may be called a space remote controller or a 3D pointing device because the corresponding pointer 205 is moved and displayed according to movement in 3D space.

4A (b) illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the image display device also moves to the left correspondingly.

Information about the movement of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The image display device may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200 . The image display device may display the pointer 205 to correspond to the calculated coordinates.

4A (c) illustrates a case in which the user moves the remote control device 200 away from the display 180 while pressing a specific button in the remote control device 200 . Accordingly, the selected area in the display 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner. Conversely, when the user moves the remote control device 200 closer to the display 180 , the selected area in the display 180 corresponding to the pointer 205 may be zoomed out and displayed. Meanwhile, when the remote control apparatus 200 moves away from the display 180 , the selection area is zoomed out, and when the remote control apparatus 200 approaches the display 180 , the selection area may be zoomed in.

On the other hand, while a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movements may be excluded. That is, when the remote control device 200 moves away from or close to the display 180 , up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state where a specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movement of the remote control device 200 .

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200 .

4B is an internal block diagram of the remote control device of FIG. 2 .

Referring to the drawings, the remote control device 200 includes a wireless communication unit 425 , a user input unit 435 , a sensor unit 440 , an output unit 450 , a power supply unit 460 , a storage unit 470 , A control unit 480 may be included.

The wireless communication unit 425 transmits/receives a signal to and from any one of the image display devices according to the embodiments of the present invention described above. Among the image display apparatuses according to embodiments of the present invention, one image display apparatus 100 will be described as an example.

In this embodiment, the remote control device 200 may include an RF module 421 capable of transmitting and receiving a signal to and from the image display device 100 according to the RF communication standard. In addition, the remote control device 200 may include an IR module 423 capable of transmitting and receiving signals to and from the image display device 100 according to the IR communication standard.

In this embodiment, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the image display device 100 through the RF module 421 .

Also, the remote control device 200 may receive a signal transmitted by the image display device 100 through the RF module 421 . In addition, the remote control device 200 may transmit commands related to power on/off, channel change, volume change, etc. to the image display device 100 through the IR module 423 as necessary.

The user input unit 435 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 435 . When the user input unit 435 includes a hard key button, the user may input a command related to the image display device 100 to the remote control device 200 through a push operation of the hard key button. When the user input unit 435 includes a touch screen, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by touching a soft key of the touch screen. In addition, the user input unit 435 may include various types of input means that the user can operate, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit 440 may include a gyro sensor 441 or an acceleration sensor 443 . The gyro sensor 441 may sense information about the movement of the remote control device 200 .

For example, the gyro sensor 441 may sense information about the operation of the remote control device 200 based on x, y, and z axes. The acceleration sensor 443 may sense information about the moving speed of the remote control device 200 . On the other hand, it may further include a distance measuring sensor, whereby the distance to the display 180 can be sensed.

The output unit 450 may output an image or audio signal corresponding to an operation of the user input unit 435 or a signal transmitted from the image display apparatus 100 . Through the output unit 450 , the user may recognize whether the user input unit 435 is operated or whether the image display apparatus 100 is controlled.

For example, the output unit 450 includes an LED module 451 that is turned on when the user input unit 435 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 425, a vibration module that generates vibration ( 453), a sound output module 455 for outputting sound, or a display module 457 for outputting an image may be provided.

The power supply unit 460 supplies power to the remote control device 200 . The power supply unit 460 may reduce power consumption by stopping the power supply when the remote control device 200 does not move for a predetermined period of time. The power supply unit 460 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 470 may store various types of programs and application data required for control or operation of the remote control device 200 . If the remote control device 200 wirelessly transmits and receives a signal through the image display device 100 and the RF module 421, the remote control device 200 and the image display device 100 transmit the signal through a predetermined frequency band. send and receive The control unit 480 of the remote control device 200 stores information about a frequency band in which a signal can be wirelessly transmitted and received with the image display device 100 paired with the remote control device 200 in the storage unit 470, and can refer to

The controller 480 controls all matters related to the control of the remote control device 200 . The control unit 480 transmits a signal corresponding to a predetermined key operation of the user input unit 435 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 440 through the wireless communication unit 425 to the image display device. (100) can be transmitted.

The user input interface unit 150 of the image display device 100 includes a wireless communication unit 151 capable of wirelessly transmitting and receiving signals with the remote control device 200 , and a pointer corresponding to the operation of the remote control device 200 . A coordinate value calculating unit 415 capable of calculating a coordinate value of may be provided.

The user input interface unit 150 may wirelessly transmit/receive a signal to and from the remote control device 200 through the RF module 412 . In addition, a signal transmitted by the remote control device 200 according to the IR communication standard may be received through the IR module 413 .

The coordinate value calculator 415 corrects hand shake or an error from the signal corresponding to the operation of the remote control device 200 received through the wireless communication unit 151 and displays the coordinate value of the pointer 205 on the display 170 . (x,y) can be calculated.

The remote control apparatus 200 transmission signal input to the image display apparatus 100 through the user input interface 150 is transmitted to the controller 180 of the image display apparatus 100 . The controller 180 may determine information about the operation and key manipulation of the remote control device 200 from the signal transmitted from the remote control device 200 , and control the image display device 100 in response thereto.

As another example, the remote control apparatus 200 may calculate a pointer coordinate value corresponding to the operation and output it to the user input interface unit 150 of the image display apparatus 100 . In this case, the user input interface 150 of the image display apparatus 100 may transmit information about the received pointer coordinate values to the controller 180 without a separate hand shake or error correction process.

Also, as another example, the coordinate value calculating unit 415 may be provided inside the control unit 170 instead of the user input interface unit 150 unlike the drawing.

FIG. 5 is an internal block diagram of the mobile terminal of FIG. 1 .

Referring to the drawings, the mobile terminal 600 includes a wireless communication unit 610 , an audio/video (A/V) input unit 620 , a user input unit 630 , a sensing unit 640 , an output unit 650 , and a memory. 660 , an interface unit 625 , a control unit 670 , and a power supply unit 690 may be included.

Meanwhile, the wireless communication unit 610 may include a broadcast receiving module 611 , a mobile communication module 613 , a wireless Internet module 615 , a sound communication unit 617 , and a GPS module 619 .

The broadcast receiving module 611 may receive at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like.

A broadcast signal and/or broadcast related information received through the broadcast reception module 611 may be stored in the memory 660 .

The mobile communication module 613 transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 615 refers to a module for wireless Internet access, and the wireless Internet module 615 may be built-in or external to the mobile terminal 600 . For example, the wireless Internet module 615 may perform WFii-based wireless communication or WiFi Direct-based wireless communication.

The acoustic communication unit 617 may perform acoustic communication. The sound communication unit 617 may output sound by adding predetermined information data to audio data to be output in the sound communication mode. Also, the sound communication unit 617 may extract predetermined information data from a sound received from the outside in the sound communication mode.

In addition, as short-range communication technologies, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The Global Position System (GPS) module 619 may receive location information from a plurality of GPS satellites.

The A/V (Audio/Video) input unit 620 is for inputting an audio signal or a video signal, and may include a camera 621 , a microphone 623 , and the like.

The user input unit 630 generates key input data input by the user to control the operation of the terminal. To this end, the user input unit 630 may include a key pad, a dome switch, a touch pad (static pressure/capacitance), and the like. In particular, when the touch pad forms a layer structure with the display 680, it may be referred to as a touch screen.

The sensing unit 640 is for controlling the operation of the mobile terminal 600 by sensing the current state of the mobile terminal 600, such as the open/closed state of the mobile terminal 600, the position of the mobile terminal 600, the presence or absence of user contact. A sensing signal can be generated.

The sensing unit 640 may include a detection sensor 641 , a pressure sensor 643 , and a motion sensor 645 . The motion sensor 645 may detect the movement or position of the mobile terminal 600 using an acceleration sensor, a gyro sensor, a gravity sensor, or the like. In particular, the gyro sensor is a sensor for measuring angular velocity, and may detect a direction (angle) that is turned with respect to a reference direction.

The output unit 650 may include a display 680 , an audio output unit 653 , a notification unit 655 , and a haptic module 657 .

The display 680 displays and outputs information processed by the mobile terminal 600 .

On the other hand, as described above, when the display 680 and the touchpad form a mutually layered structure and are configured as a touch screen, the display 680 may also be used as an input device capable of inputting information by a user's touch in addition to an output device. can

The audio output unit 653 outputs audio data received from the wireless communication unit 610 or stored in the memory 660 . The audio output unit 653 may include a speaker, a buzzer, and the like.

The notification unit 655 outputs a signal for notifying the occurrence of an event in the mobile terminal 600 . For example, the signal may be output in the form of vibration. .

The haptic module 657 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 657 is a vibration effect.

The memory 660 may store a program for processing and control of the controller 670, and provides a function for temporary storage of input or output data (eg, phone book, message, still image, video, etc.). can also be done

The interface unit 625 functions as an interface with all external devices connected to the mobile terminal 600 . The interface unit 625 may receive data or receive power from such an external device and transmit it to each component inside the mobile terminal 600 , and may allow the data inside the mobile terminal 600 to be transmitted to an external device. .

The controller 670 controls the overall operation of the mobile terminal 600 by generally controlling the operation of the respective units. For example, it may perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 670 may include a multimedia playback module 681 for multimedia playback. The multimedia playback module 681 may be configured as hardware in the control unit 670 , or may be configured as software separately from the control unit 670 .

The power supply unit 690 receives external power and internal power under the control of the control unit 670 to supply power required for operation of each component.

Meanwhile, a block diagram of the mobile terminal 600 shown in FIG. 5 is a block diagram for an embodiment of the present invention. Each component in the block diagram may be integrated, added, or omitted according to the specifications of the mobile terminal 600 that are actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed in each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

6 is a flowchart illustrating an example of an operation method of an image display device and a mobile terminal according to an embodiment of the present invention, and FIGS. 7A to 11C are diagrams referenced to explain the operation method of FIG. 6 .

First, referring to FIG. 6 , the controller 170 of the image display device 100 may control to display a mirroring-related menu including mirroring-related server information or content related to server information based on a user input. (S610).

For example, the control unit 170 of the image display device 100, when there is a specific key input of the remote control device 200, displays a mirroring related menu including mirroring related server information or content related to server information can be controlled to do so.

For example, content related to server information may include a code image including server information. More specifically, it may include a QR code image including server information.

As another example, content related to server information may be output as a predetermined sound.

Next, the controller 670 of the mobile terminal 600 may acquire mirroring-related server information or content related to server information displayed on the image display device 100 (S620). Then, the control unit 670 of the mobile terminal 600 may recognize the mirroring related server information (S625).

For example, the mobile terminal 600 may capture a code image displayed on the image display device 100 through the camera 621 . Then, the controller 670 of the mobile terminal 600 may extract server information from the captured code image, and recognize the extracted server information.

As another example, the mobile terminal 600 may extract server information from a sound received through the microphone 623 and recognize the extracted server information.

Next, the controller 670 of the mobile terminal 600, based on the recognized mirroring-related server information, can control to access the server (S623). Correspondingly, the server 500 may connect to the mobile terminal 600 (S624).

For example, the server 500 is a server operated by the manufacturer of the image display device 100 , and may be a server corresponding to mirroring-related server information installed at the time of manufacturing the image display device 100 .

As such, the user of the mobile terminal 600 can simply access the server 500 through the mirroring-related server information or server information-related content displayed on the image display device 100 .

Meanwhile, the server 500 may transmit a mirroring related application to the mobile terminal 600 when the mobile terminal 600 is connected (S625).

Correspondingly, the control unit 670 of the mobile terminal 600, from the server 500, the mirroring-related application, through the communication unit 610, etc., receive (S626), the mirroring-related application, can be installed . Then, the installed mirroring-related application can be executed (S628).

Accordingly, it is possible to easily install and execute a mirroring-related application in the mobile terminal 600 .

Next, the control unit 670 of the mobile terminal 600 determines whether or not an application item to be mirrored is selected (S632), and if applicable, control to transmit the selected application item to the image display device 100 There is (S645).

For example, the controller 670 of the mobile terminal 600 may select an application item to be mirrored with the image display device 100 from among a plurality of applications installed in the mobile terminal 600 through a mirroring related application.

At least one application item may be selected, and the controller 670 of the mobile terminal 600 may transmit information on the at least one selected application item to the image display device 100 .

In particular, the controller 670 of the mobile terminal 600 may transmit name information, application image information, user information, application version information, and the like of at least one selected application item to the image display device 100 .

Next, the control unit 170 of the image display device 100 may receive the selected mirroring application item from the mobile terminal 600 through the network interface unit 130 or 145 ( S650 ).

And, the control unit 170 of the image display device 100, the received mirroring application item, installed on the image display device 100, in particular, control the received selected mirroring application item to be displayed in the mirroring related menu (S660). Accordingly, it is possible to easily install and display the mirroring application item from the mobile terminal, on the image display device 100 .

Hereinafter, the operation method of FIG. 6 will be described with reference to FIGS. 7A to 11C .

The controller 170 of the image display device 100 may control to display the broadcast image 700 based on the broadcast signal received from the broadcast receiver 105 on the display 180 as shown in FIG. 7A .

At this time, when there is a specific key input of the remote control device 200, the control unit 170 of the image display device 100, as shown in FIG. 7b, includes a broadcast image 701 corresponding to a broadcast signal and an application list ( 710) can be controlled to be displayed together.

The controller 170 of the image display apparatus 100 may control the application list 710 to be displayed in an overlapping manner on the broadcast image 701 as shown in FIG. 7B .

Meanwhile, the application list 710 may include a mirroring item 715a, an additional view item 719, or an application item.

Meanwhile, FIG. 7C illustrates that a mirroring item 715b, different from FIG. 7B , is displayed in the application list 710 . For the user's convenience of recognition, the mirroring item 715b may be displayed as an object representing mirroring.

On the other hand, when the mirroring item (715a or 715b)) is selected, the controller 170 of the image display apparatus 100, as shown in FIG. 7D, mirroring including server information related to mirroring or content 720 related to server information It can be controlled to display a related menu 717 .

The mirroring related menu 717 may be displayed in a form that is expanded to the right according to the selection of the mirroring item 715a or 715b.

Meanwhile, the mirroring related menu 717 may further include a return item 716 to restore the mirroring item 715a or 715b.

Meanwhile, the content 720 related to server information may include a code image including server information. For example, the content 720 related to server information may include a QR code image including server information, as shown in FIG. 7D .

On the other hand, in a state in which the content 720 related to server information is displayed on the image display device 100, the camera 621 of the mobile terminal 600 is to capture the content 720 related to the server information as shown in FIG. 7E. can

In addition, the controller 670 of the mobile terminal 600 may receive the captured content image 720b and recognize it. In this case, the controller 670 of the mobile terminal 600 may control to display the content image 720b related to the hit server information on the display 180 .

The controller 670 of the mobile terminal 600 may extract server information from the captured content image 720b.

In addition, the controller 670 of the mobile terminal 600 may control access to the server 500 based on the extracted server information.

For example, the control unit 670 of the mobile terminal 600 transmits a connection request signal Sreg1 to the server 500 to access the server 500, as shown in FIG. 7f, and the server 500 A connection response signal Sres1 may be received from

Next, the controller 670 of the mobile terminal 600 may receive a mirroring-related application from the server 500 as shown in FIG. 7G .

More specifically, the controller 670 of the mobile terminal 600 may control to display a screen 732 for downloading a mirroring app, as shown in (a) of FIG. 7G .

At this time, when the download item 732 is selected by the user's touch input or the like, the controller 670 of the mobile terminal 600 downloads the mirroring app, and when the download is completed, (b) of FIG. 7G and Similarly, the download completion screen 734 may be controlled to be displayed.

Next, the control unit 670 of the mobile terminal 600 may install the downloaded mirroring setting application. In this case, the controller 670 of the mobile terminal 600 may control the installation screen 736 to be displayed, as shown in (c) of FIG. 7G .

And, when the installation is completed, the controller 670 of the mobile terminal 600 may control the installation completion screen 738 to be displayed as shown in (d) of FIG. 7G .

Next, the controller 670 of the mobile terminal 600 may execute the installed mirroring setting application.

This will be described with reference to FIGS. 8A to 8I.

First, FIG. 8A illustrates an idle screen 810 or a home screen 810 of a mobile terminal 600 . The standby screen 810 or the home screen 810 may be displayed on the display 680 . Meanwhile, at the bottom of the screen, a plurality of application items may be displayed. In the drawing, it is exemplified that a mirroring application item 812 is displayed among a plurality of application items.

In the standby screen 810 or home screen 810 of the mobile terminal 600 in FIG. 8A, when the mirroring application item 812 is selected or the mirroring application download in FIG. 7G is completed, the mirroring application is automatically executed. can

The controller 670 of the mobile terminal 600 may control to display the mirroring setting application screen 820, as shown in FIG. 8b, when the mirroring application is executed.

The mirroring setting application screen 820 is a settable item 822, a TV selection item 824, an application registration item 826, a user information edit item 823, a horizontal and vertical view setting item 813, a password item (814) and the like.

When the settable item 822 is selected and activated, the control unit 670 of the mobile terminal 600 includes a TV selection item 824 , an application registration item 826 , a user information editing item 823 , and a horizontal and vertical view. The setting item 813 and the password item 814 may be controlled to be activated and displayed as shown in FIG. 8C . Accordingly, various settings and the like can be performed.

When the TV selection item 824 is selected, the control unit 670 of the mobile terminal 600 searches for nearby TVs, and upon completion of the search, as shown in FIG. 8D , a TV list including at least one TV item The screen 830 may be controlled to be displayed. In the figure, two TV items are illustrated.

Among them, when the first TV item 832 is selected, the controller 670 of the mobile terminal 600 completes the setting for mirroring with the selected first TV item 832 , and after the setting is completed, FIG. 8E . As such, it is possible to control the mirroring setting application screen 820 to be displayed again.

Next, in the state where the mirroring setting application screen 820 is displayed, as shown in FIG. 8f , when the application registration item 826 is selected, the controller 670 of the mobile terminal 600, as shown in FIG. 8g, the mobile terminal ( It is possible to control to display the application list 850 including the application items installed in 600).

On the other hand, when a plurality of application items in the application list 850, for example, the Internet application item 852 and the camera application item 854 are selected, the control unit 670 of the mobile terminal 600 is shown in FIG. 8H and Likewise, it is possible to control the Internet application item 852 and the camera application item 854 to be highlighted.

In addition, when a storage item or the like is selected, the controller 670 of the mobile terminal 600 may control the mirroring setting application screen 820 to be displayed again, as shown in FIG. 8i . In this case, the application registration item 826b may include the selected two application-related information 827 .

Next, the controller 670 of the mobile terminal 600 may control to transmit information related to the two selected application items to the image display device 100 as shown in FIG. 8J . In this case, the controller 670 of the mobile terminal 600 may control to display two pieces of application transmission information on the display 680 .

The image display device 100 may receive information related to two application items to be mirrored through the interface unit 130 or 135 .

The control unit 170 of the image display device 100 controls to install the received mirroring application item in the image display device 100, and in particular, as shown in FIG. 8k, control to be displayed in the mirroring related menu 717. can

The controller 170 of the image display device 100 may select a first mirroring application item from among the mirroring application items displayed in the mirroring related menu 717 .

For example, by using the direction key and the confirmation key of the remote control device 200, it is possible to select the first mirroring application item.

As another example, based on a pointing signal included in the RF signal of the remote control device 200, a pointer is displayed, and the first mirroring application item can be selected by the pointer.

The control unit 170 of the image display device 100, when the first mirroring application item is selected among the mirroring application items displayed in the mirroring related menu 717, to the mobile terminal 600, pairing information or the first mirroring application Control to transmit the execution request information, from the mobile terminal 600, the first mirroring application execution image, through the network interface unit 130 or 135, to receive, and display the received first mirroring application execution image (180) ) can be controlled to be displayed.

9A illustrates a case in which the camera application item 712 is selected among the mirroring application items 711 and 712 displayed in the mirroring related menu 717, and accordingly, from the image display device 100 to the mobile terminal 600 , exemplifies that the camera application execution request information (Ssta) is transmitted.

When the control unit 680 of the mobile terminal 600 receives the camera application execution request information Ssta, as shown in FIG. 9A , the control unit 680 controls the camera application to be executed, and the displayed home screen or standby screen 810 is displayed. , can be controlled to switch to the camera application screen.

Then, the controller 680 of the mobile terminal 600 enters the mirroring mode, and controls to transmit the image Saib corresponding to the camera application screen 840a to the image display device 100 as shown in FIG. 9B . can do.

Accordingly, the control unit 170 of the image display device 100 receives, through the interface unit 130 or 135, the image Saib corresponding to the camera application screen 840a, and performs signal processing such as scaling. By doing so, an image 840b corresponding to the camera application screen 840a may be controlled to be displayed on the display 180 .

In FIG. 9b, the mirrored camera application image 840b is exemplified to be displayed together with the application list 710, but, unlike in FIG. 1, the application list 710 disappears, and the mirrored camera application image 840b ) may be displayed on the display 180 .

On the other hand, the controller 170 may control the communication method when the pairing request signal and the communication method when transmitting the mirroring application image to be different from each other.

For example, the controller 170 controls the pairing signal or the pairing request signal to communicate as a Bluetooth-based BLE (Blooth Low Energy) signal, and has a wider bandwidth when transmitting a mirroring application image, It is possible to control so that the Wi-Fi communication method by the Miracast method is used.

Meanwhile, FIGS. 10A to 10D are another example for installing a mirroring application on the image display device 100 using a mobile terminal 600 , which is different from FIGS. 8F to 8I .

When the application registration item 826 is selected as shown in FIG. 10A in a state where the mirroring setting application screen 820 is displayed on the mobile terminal 600, the control unit 670 of the mobile terminal 600 is shown in FIG. 10B and Similarly, it is possible to control to display the application list 950 including the application items installed in the mobile terminal 600 .

On the other hand, when a plurality of application items in the application list 950, for example, a messenger application item 952, a message application item 954, and a player item 956 for multimedia data reproduction are selected, the mobile terminal 600 ), the controller 670 may control the messenger application item 952 , the message application item 954 , and the player item 956 for multimedia data playback to be highlighted as shown in FIG. 10C .

In addition, when a storage item or the like is selected, the controller 670 of the mobile terminal 600 may control the mirroring setting application screen 820 to be displayed again, as shown in FIG. 10D . In this case, the application registration item 926b may include selected three application-related information 927 .

Next, the controller 670 of the mobile terminal 600 may control to transmit information related to the three selected application items to the image display device 100 . In this case, the controller 670 of the mobile terminal 600 may control to display three application transmission information on the display 680 .

The image display device 100 may receive, through the interface unit 130 or 135 , information related to three application items to be mirrored.

The control unit 170 of the image display device 100 controls the received mirroring application item to be installed in the image display device 100, in particular, as shown in FIG. 11a, in the application list 1110, within the mirroring related menu. , can be controlled to display.

In FIG. 11A , as a mirroring application transmitted from the mobile terminal 600 , a messenger application item 1111 , a message application item 1112 , and a player item 1113 for multimedia data reproduction are exemplified.

Meanwhile, the mirroring related menu may further include a return item 1116 , an application addition item 1119 , and the like for restoration to the mirroring item 715a or 715b of FIG. 7B or 7C .

On the other hand, the control unit 170 of the image display device 100 may select a predetermined application item among the mirroring application items displayed in the mirroring related menu, and transmit information about the selected application item to the mobile terminal 600 . control, and accordingly, an application image executed in the mobile terminal 600 may be received. And, as the pre-run mode, the received application image may be displayed on the display 180 .

Meanwhile, FIGS. 11B to 11C illustrate a method of further adding a mirroring application while the three mirroring application items shown in FIG. 11A are displayed.

For example, when the application addition item 1119 of FIG. 11A is selected, the controller 170 of the image display apparatus 100 may access the mobile terminal 600 .

In this case, the controller 680 of the mobile terminal 600 may receive the application additional information, control the mirroring application to be executed, and control the mirroring setting application screen 820 to be displayed, as shown in FIG. 11B .

As another example, the control unit 680 of the mobile terminal 600, for adding the mirroring application to the image display device 100, when the user, when running the mirroring application, as shown in Figure 11b, controls the mirroring application to be executed and , it is possible to control the mirroring setting application screen 820 to be displayed.

Meanwhile, the controller 680 of the mobile terminal 600 may control the image data Saib corresponding to the mirroring setting application screen 820 to be transmitted to the image display device 100 as shown in FIG. 11B . In the drawing, it is exemplified that an image 851 corresponding to the mirroring application execution screen is displayed on the display 180 of the image display device 100 .

On the other hand, the control unit 670 of the mobile terminal 600, when a plurality of application items in the application list 850, for example, the Internet application item 852, the camera application item 854 is selected, the mobile terminal ( The controller 670 of the 600 may control the Internet application item 852 and the camera application item 854 to be highlighted as shown in FIG. 11B .

Next, when there is an additional input for the two selected application items, the controller 670 of the mobile terminal 600 may control the transmission to the image display device 100 as shown in FIG. 11C . In this case, the controller 670 of the mobile terminal 600 may control to display two pieces of application transmission information on the display 680 .

The image display device 100 may receive information related to two application items to be mirrored through the interface unit 130 or 135 .

The control unit 170 of the image display device 100 controls the received mirroring application item to be installed in the image display device 100, in particular, as shown in FIG. 11c, in the mirroring related menu, already added, messenger application The item 1111, the message application item 1112, and the player item 1113 for multimedia data reproduction, the Internet application item 711, and the camera application item 712 can be controlled to be displayed. Accordingly, it is possible to easily add the application related to the mirrung, in the application list of the image display device 100, in particular, in the menu related to mirroring.

12 is a flowchart illustrating an example of an operation method of an image display device and a mobile terminal according to another embodiment of the present invention, and FIGS. 13A to 14C are diagrams referenced to explain the operation method of FIG. 12 .

First, referring to FIG. 12 , the controller 170 of the image display apparatus 100 controls to display a mirroring related menu based on a user input ( S1210 ).

For example, as shown in FIG. 7A , when a home key or an application execution key is operated while the broadcast image 700 is displayed, an application list 710 may be displayed at the bottom of the screen as shown in FIG. 7B . . In this case, the application list may include a plurality of application items, and in particular, may include a mirroring application item 715a or 715b, such as FIG. 7B or 7C.

When the mirroring application item 715a or 715b is selected by the pointer 205 based on the pointing signal of the remote control device 200, similarly to the pull-down menu, it expands to the right, and the mirroring related menu 717 is displayed. can be displayed.

Mirroring-related menu 717, if mirroring-related applications are not added, as shown in FIG. 7d, for mirroring-related application installation, may include a code image 720, as shown in FIGS. 8a to 8k, When an application related to mirroring is added, the code image 720 display may disappear, and application items related to installed mirroring may be displayed.

Hereinafter, it will be described on the assumption that application items related to mirroring are installed in the mirroring related menu.

Next, the control unit 170 of the image display device 100, in the mirroring related menu, when any one application item is selected by the pointer 205 or the like based on the pointing signal of the remote control device 200 (S1220) ), control to transmit a pairing request signal to the mobile terminal 600 (S1225).

In response to this, the controller 670 of the mobile terminal 600 receives a pairing request signal (S1230) and controls to transmit a pairing response signal (S1232).

In response to this, the control unit 170 of the image display device 100 receives a pairing response signal (S1234). Based on this, the controller 170 of the image display apparatus 100 connects to the mobile terminal 600 and controls to maintain the connection with the mobile terminal 600 .

Meanwhile, the controller 170 of the image display device 100 may control to transmit information on the selected application item to the mobile terminal 600 in addition to the pairing request signal.

Accordingly, the controller 670 of the mobile terminal 600 may receive information on the selected application item, and control the mobile terminal 600 to execute the corresponding application based on the received information on the application item. There is (S1235).

Next, the controller 670 of the mobile terminal 600 may control to transmit an image for the executed application to the image display device 100 (S1245).

Correspondingly, the control unit 170 of the image display device 100, through the interface unit 130 or 135, receives an image of the executed application (S1250), and displays the received image of the executed application. It can be controlled to do so (S1260).

13A illustrates that the player application item 1113 is selected from among a plurality of mirroring application items in the application list 1110 on the display 180 of the image display device 100 .

Accordingly, the controller 170 of the image display device 100 transmits a pairing request signal Spai to the mobile terminal 600 on which the home screen or the standby screen 810 is displayed, and from the mobile terminal 600 . A pairing response signal Spar may be received.

On the other hand, the control unit 170 of the video display device 100, in addition to the pairing request signal (Spai), additionally, as shown in FIG. 13b, information (SMX) on the selected application item to the mobile terminal 600, to transmit can be controlled

The mobile terminal 600 on which the home screen or standby screen 810 is displayed, based on the received information (SMX) on the application item, executes the corresponding application in the mobile terminal 600, as shown in FIG. 13b . , an image of the application being executed may be displayed on the display 680 .

In particular, FIG. 13B illustrates a content list screen among the player application screens. When any one of these contents is selected, a screen 1320 to be reproduced may be displayed on the display 680 of the mobile terminal 600 as shown in FIG. 13C .

And, according to the mirroring mode, the image corresponding to the screen 1320 to be reproduced is transmitted to the image display device 100, and the image corresponding to the screen to be reproduced on the display 180 of the image display device 100 ( 1320a) can be displayed. Therefore, it is possible to conveniently perform mirroring between the image display device 100 and the mobile terminal 600 .

Meanwhile, FIGS. 14A to 14C illustrate that a messenger application is selected and mirrored, unlike FIGS. 13A to 13C .

14A illustrates that the messenger application item 1111 is selected from among a plurality of mirroring application items in the application list 1110 on the display 180 of the image display device 100 .

Accordingly, the controller 170 of the image display device 100 transmits a pairing request signal Spai to the mobile terminal 600 on which the home screen or the standby screen 810 is displayed, and from the mobile terminal 600 . A pairing response signal Spar may be received.

On the other hand, the control unit 170 of the image display device 100, in addition to the pairing request signal (Spai), additionally, as shown in FIG. 14b, information on the selected application item to the mobile terminal 600, it can be controlled to transmit have.

The mobile terminal 600 on which the home screen or the standby screen 810 is displayed converts the standby screen of the mobile terminal 600 to the home screen 1410 as shown in FIG. 14B based on the received information on the application item. Alternatively, the control may be performed to switch from the first home screen to the second home screen 1410 in which the selected application item is located.

Next, when the messenger application item 1412 is selected on the home screen 1410 of FIG. 14B , the controller 670 of the mobile terminal 600 executes the corresponding application, and as shown in FIG. 14C , the image of the executed application 1420 may be displayed on the display 680 .

In addition, the controller 670 of the mobile terminal 600 controls so that an image corresponding to the executed application image 1420 is transmitted to the image display device 100 according to the mirroring mode.

Accordingly, the image 1420a corresponding to the executed application can be displayed on the display 180 of the image display device 100 . Therefore, it is possible to conveniently perform mirroring between the image display device 100 and the mobile terminal 600 .

15 is a flowchart illustrating an example of an operation method of the video display device 100 and a mobile terminal according to another embodiment of the present invention, and FIGS. 16A to 20F are diagrams referenced to explain the operation method of FIG. 15 .

First, referring to FIG. 15 , the controller 170 of the image display device 100 controls to display a mirroring related menu based on a user input ( S1510 ).

For example, as shown in FIG. 7A , when a home key or an application execution key is operated while the broadcast image 700 is displayed, an application list 710 may be displayed at the bottom of the screen as shown in FIG. 7B . . In this case, the application list may include a plurality of application items, and in particular, may include a mirroring application item 715a or 715b, such as FIG. 7B or 7C.

When the mirroring application item 715a or 715b is selected by the pointer 205 based on the pointing signal of the remote control device 200, similarly to the pull-down menu, it expands to the right, and the mirroring related menu 717 is displayed. can be displayed.

Next, the control unit 170 of the image display device 100, in the mirroring related menu, when the first user item is selected by the pointer 205 or the like based on the pointing signal of the remote control device 200 (S1520) , control to transmit a pairing request signal to the mobile terminal 600a corresponding to the first user (S1525).

In response to this, the controller 670 of the mobile terminal 600a corresponding to the first user receives a pairing request signal (S1530) and controls to transmit a pairing response signal (S1532).

In response to this, the control unit 170 of the image display apparatus 100 receives a pairing response signal (S1534). Based on this, the controller 170 of the image display device 100 controls to access the first user's mobile terminal 600a and maintain the connection with the first user's mobile terminal 600a.

On the other hand, the controller 170 of the image display device 100, in addition to the pairing request signal, can additionally control to transmit information on the selected application item to the mobile terminal 600a of the first user.

Accordingly, the control unit 670 of the first user's mobile terminal 600a receives information on the selected application item, and based on the received information on the application item, transmits the corresponding application to the first user's mobile terminal ( 600a) can be controlled to be executed (S1535).

Next, the controller 670 of the mobile terminal 600a of the first user may control to transmit an image for the executed application to the image display device 100 (S1545).

Correspondingly, the control unit 170 of the image display device 100, through the interface unit 130 or 135, receives an image for the application being executed (S1550), and displays the image for the received application to be executed It can be controlled to do so (S1560).

16A illustrates a case in which the user information edit item 823 is selected while the mirroring setting application screen 820 is displayed on the mobile terminal 600 .

Accordingly, the controller 670 of the mobile terminal 600 may control the user information setting screen 1600 to be displayed as shown in FIG. 16B .

The user information setting screen 1600 may include a profile image item 1602 , a name item 1604 , a genre item 1606 , and the like.

When the profile image item 1602 is selected, the controller 670 of the mobile terminal 600 may activate the camera 621 to capture a face image of the user. And, as shown in FIG. 16C , a screen 1610 for editing the captured image may be controlled to be displayed.

Upon completion of editing, the controller 670 of the mobile terminal 600 may control the edited user image 1615 to be located in the profile image item 1602 as shown in FIG. 16D .

Next, when the name item 1604 in the user information setting screen 1600 is selected, the controller 670 of the mobile terminal 600 may control the name input window 1620 to be displayed as shown in FIG. 16E . .

Meanwhile, when the genre item 1606 in the user information setting screen 1600 is selected, the controller 670 of the mobile terminal 600 may control the genre setting window 1625 to be displayed as shown in FIG. 16F .

When the user information setting on the user information setting screen 1600 is completed, the control unit 670 of the mobile terminal 600 transmits the set user information as well as application information to be mirrored to the image display device 100 . can be controlled

Accordingly, the control unit 170 of the image display device 100 receives, through the interface unit 130 or 135, the set user information as well as the application information to be mirrored, and adds a user item to the application list. can be controlled

17A illustrates that a plurality of application items and a first user item 1705 for mirroring are displayed in the application list 1710 .

On the other hand, the control unit 170 of the image display device 100, in order to distinguish the first user item 1705 from other items, the user image 1707 included in the received user information is superimposed on the first user item. can be controlled to be displayed. Accordingly, the first user item 1705 can be intuitively recognized.

On the other hand, when the first user item 1705 in the application list 1710 is selected, the control unit 170 of the image display device 100, as shown in FIG. 17B, expands the first user item 1705, 1 A user-related menu 1720 may be controlled to be displayed.

The first user-related menu 1720 may include a plurality of application items 1711 , 1712 , and 1713 , a return item 1716 , and an additional item 1719 set in the first user mobile terminal 600a . .

Among them, when the player item 1713 for playing multimedia data is selected, the controller 170 of the image display device 100 displays the home screen or the standby screen 810 of the first user's mobile terminal 600a. ), a pairing request signal Spai may be transmitted, and a pairing response signal Spar may be received from the mobile terminal 600 .

On the other hand, the control unit 170 of the image display device 100, in addition to the pairing request signal (Spai), in addition, as shown in FIG. 17c, information (S) on the selected application item, the first user's mobile terminal (600a) ), which can be controlled to transmit.

The first user's mobile terminal 600a on which the home screen or standby screen 810 is displayed, based on the received information (S) on the application item, within the first user's mobile terminal 600a, the corresponding application , and as shown in FIG. 17C , an image of the application to be executed 1740a may be displayed on the display 680 .

In particular, FIG. 17C illustrates a content list screen 1740a among the player application screens. When any one of the contents 1742a is selected, a reproduced screen 1750 may be displayed on the display 680 of the first user's mobile terminal 600a as shown in FIG. 17D .

And, according to the mirroring mode, the image corresponding to the screen 1750 to be reproduced is transmitted to the image display device 100, and the image corresponding to the screen to be reproduced on the display 180 of the image display device 100 ( 1750a) can be displayed. Therefore, it is possible to conveniently perform mirroring between the image display device 100 and the mobile terminal 600 .

Meanwhile, FIG. 18A exemplifies that an additional setting item 818 is selected in the mirroring setting application screen 820, displayed on the mobile terminal 600 .

Accordingly, the controller 670 of the mobile terminal 600 may control the TV notification item 819 to be displayed as shown in FIG. 18B .

When the TV notification item 819 is selected, as shown in FIG. 18c , a screen 1810 including a notification setting item 817 may be displayed, and when the notification setting item 817 is selected, as shown in FIG. 18d , the notification setting may be completed.

Accordingly, when a notification message is received from an external server or the like in the mirroring application installed in the mobile terminal, the controller 670 of the mobile terminal 600 may control it to be delivered to the image display device 100 .

That is, as shown in FIG. 18E , a notification message of the messenger application is received from the mobile terminal 600 to the image display device 100 , and accordingly, the controller 170 of the image display device 100 displays the displayed mirroring. It is possible to control the application item 1111 (in, the notification message 1111a) to be additionally displayed. Accordingly, the image display device 100 can also check the notification message at any time.

Meanwhile, FIG. 19A exemplifies that the horizontal and vertical view setting items 813 are selected on the mirroring setting application screen 820 displayed on the mobile terminal 600 .

Accordingly, the controller 670 of the mobile terminal 600 may control the horizontal and vertical view setting window 1820 to be displayed as shown in FIG. 19B .

The horizontal and vertical view setting window 1820 may include an auto-rotation item 1822 , a vertical view item 1824 , and a horizontal view item 1826 . Accordingly, the image is displayed on the image display device 100 according to the set method.

For example, when the horizontal view item 1826 is selected and set, the controller 170 of the image display device 100 receives the horizontal view item setting information, and accordingly, as shown in FIG. 19C , the mobile terminal ( The vertical screen 1900 of 600 may be set and displayed in the image display apparatus 100 as the horizontal screen 1900a.

On the other hand, FIG. 20A illustrates that the password item 814 is selected in the mirroring setting application screen 820 displayed on the mobile terminal 600 .

Accordingly, the controller 670 of the mobile terminal 600 may control the password setting window 1830 and the number input window 1836 to be displayed, as shown in FIG. 20B .

The controller 670 of the mobile terminal 600 may control the mirroring setting application screen 820 to be displayed again as shown in FIG. 20D when a predetermined number is input and completed as shown in FIG. 20C .

In this case, the password item 814 may include password setting completion information 814a.

The control unit 670 of the mobile terminal 600 controls to transmit the set password information to the image display device 100 , and the image display device 100 may receive the set password information.

On the other hand, this password information, under the mirroring related menu, when selecting the first user item, or can be utilized when selecting a specific mirroring application item.

For example, when the first user item 1705 of FIG. 17c is selected, the control unit 170 of the image display device 100 does not immediately display the mirroring application item corresponding to the first user item, as shown in FIG. 20e It is possible to control the password input window 2010 to be displayed.

Meanwhile, the password input window 2010 may include a display window 2013 and a number input window 2016 .

On the other hand, if the input password matches, the control unit 170 of the image display device 100, as shown in FIG. 20f, under the mirroring related menu, a plurality of mirroring application items (1111, 1112, 1113), etc., additional items (1119) and the like can be controlled to be displayed. Thereby, it is possible to provide a mirroring mode only for a specific user.

On the other hand, password setting can be applied only to a specific application item, and even in this case, it is possible to provide a mirroring mode for a specific application.

On the other hand, the method of operating an image display device or a mobile terminal of the present invention can be implemented as a processor-readable code on a processor-readable recording medium provided in the image display device or the mobile terminal. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also includes those implemented in the form of carrier waves such as transmission over the Internet . In addition, the processor-readable recording medium is distributed in a computer system connected to a network, so that the processor-readable code can be stored and executed in a distributed manner.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (16)

display;
an interface unit for exchanging data with the mobile terminal; and
Based on a user input, control to display a mirroring-related menu including mirroring-related server information or server information-related content, and receive a mirroring application item from the mobile terminal, through the interface unit, and the received mirroring application Includes; a control unit for controlling the items to be displayed in the mirroring related menu;
The control unit is
Display an application list including a plurality of application items and a first user item for mirroring, and when the first user item in the application is selected, in the application list, a first including the received mirroring application item Controls the display of user-related menus,
The first user item is displayed together with an image related to the first user,
The first user-related menu is,
An application item for mirroring, an additional item for adding a mirroring application, and a return item for displaying the previous screen. According to claim 1,
Content related to the server information,
Video display device comprising a code image including the server information. According to claim 1,
The control unit is
When a first mirroring application item is selected among the mirroring application items displayed in the mirroring related menu, control to transmit pairing information or the first mirroring application execution request information to the mobile terminal,
From the mobile terminal, a first mirroring application execution image, through the interface unit, and receiving, and the image display device, characterized in that the control to display the received first mirroring application execution image on the display. According to claim 1,
A broadcast receiving unit for receiving a broadcast signal; further comprising,
The control unit is
In a state in which the broadcast image corresponding to the broadcast signal and the application list are displayed, based on the user input, the mirroring related menu is controlled to be displayed in the application list. According to claim 1,
It further includes; a user input interface unit for exchanging data with the remote control device;
The control unit is
Control to display a pointer based on a pointing signal of the remote control device, and display a mirroring related menu including the mirroring related server information or content related to server information when a mirroring item is selected based on the pointer An image display device, characterized in that it is controlled to do so. display;
an interface unit for exchanging data with the mobile terminal; and
Based on a user input, control to display a mirroring related menu, control to transmit a pairing request signal to the mobile terminal when the first mirroring application item in the mirroring related menu is selected, through the interface unit, the first A mirroring application image, from the mobile terminal, receiving, and a control unit for controlling to display the received first mirroring application image; includes,
Display an application list including a plurality of application items and a first user item for mirroring, and when the first user item in the application is selected, in the application list, a first including the received mirroring application item Controls the display of user-related menus,
The first user item is displayed together with an image related to the first user,
The first user-related menu is,
An application item for mirroring, an additional item for adding a mirroring application, and a return item for displaying the previous screen. 7. The method of claim 6,
The control unit is
When a pairing response signal corresponding to the pairing request signal is received through the interface unit, the video display device is configured to control to maintain a connection with the mobile terminal. 7. The method of claim 6,
The control unit is
Video display device, characterized in that the control to transmit the first mirroring application execution request information to the mobile terminal. 7. The method of claim 6,
The control unit is
Video display device, characterized in that the control so that the communication method when transmitting the pairing request signal and the communication method when receiving the first mirroring application image are different from each other. 7. The method of claim 6,
A broadcast receiving unit for receiving a broadcast signal; further comprising,
The control unit is
In a state in which the broadcast image corresponding to the broadcast signal and the application list are displayed, based on the user input, the mirroring related menu is controlled to be displayed in the application list. 7. The method of claim 6,
It further includes; a user input interface unit for exchanging data with the remote control device;
The control unit is
Control to display a pointer based on a pointing signal of the remote control device, and control to display the mirroring related menu including the first mirroring application item when a mirroring item is selected based on the pointer A video display device characterized in that. display;
an interface unit for exchanging data with the mobile terminal; and
Based on a user input, control to display a mirroring-related menu or mirroring item, and when the first user item in the mirroring-related menu or the mirroring item is selected, a pairing request signal is transmitted to the mobile terminal corresponding to the first user Control to control, and through the interface unit, the first mirroring application image, from the first user mobile terminal, receiving, and includes a 'control unit for controlling to display the received first mirroring application image,
The first user item is displayed together with an image related to the first user,
The mirroring related menu is,
An application item for mirroring, an additional item for adding a mirroring application, and a return item for displaying the previous screen. 13. The method of claim 12,
The control unit is
When a pairing response signal corresponding to the pairing request signal is received through the interface unit, the video display device, characterized in that the control is maintained to maintain the connection with the first user mobile terminal. 13. The method of claim 12,
The control unit is
Video display device, characterized in that the control to transmit the first mirroring application execution request information to the first user mobile terminal. 13. The method of claim 12,
The control unit is
Video display device, characterized in that the control so that the communication method when the pairing request signal and the communication method of the first mirroring application image are different from each other. 13. The method of claim 12,
A broadcast receiving unit for receiving a broadcast signal; further comprising,
The control unit is
In a state in which a broadcast image and an application list corresponding to the broadcast signal are displayed, based on the user input, the mirroring related menu or the mirroring item is controlled to be displayed in the application list.

Images