KR20130010686A - Method for operating a mobile terminal and an image display device - Google Patents

Abstract

PURPOSE: A portable terminal and an operation method of an image display device are provided to display various information in order to conveniently use an image display device. CONSTITUTION: A portable terminal receives a command for sharing content displayed on an image display device(S710). The portable terminal displays an image based on the content(S720). The portable terminal displays an input window corresponding to the image(S730). The portable terminal transmits a signal to the image display device based on input window information(S740). The portable terminal transmits content reproducing command to the image display device. [Reference numerals] (AA) Start; (BB) End; (S710) Content sharing command; (S720) Image display; (S730) Input window display; (S740) Signal transmission

Description

Method for operating a mobile terminal and an image display device

The present invention relates to a method of operating a mobile terminal and an image display apparatus capable of sharing content and information. More particularly, the present invention relates to a portable terminal capable of improving user convenience by displaying various information in association with the portable terminal and the image display apparatus, and an image display apparatus that can be controlled by the portable terminal.

Recently, network technologies have been developed in which various electronic devices are connected to each other to enjoy convenient, safe and economical living services at home and at any time. Such a network is configured by connecting electronic devices such as a PC, a TV, a refrigerator, and a portable terminal of a plurality of members, to share or transmit various data.

On the other hand, the portable terminal is a portable device that is portable and has at least one function of inputting and outputting information, performing a voice and video call, and storing a data. As the functions of the mobile terminals are diversified, they are equipped with complex functions such as taking pictures or videos, playing music files or video files, playing games, receiving broadcasts, wireless Internet, and the like. It is implemented in the form.

On the other hand, the portable terminal provides various and convenient user interface environments such as touch input and menu screen for inputting characters by touch input through the screen.

Accordingly, an object of the present invention is to provide an operation method of a portable terminal and an image display apparatus which can improve user convenience.

Another object of the present invention is to provide a user terminal that can be applied to a mobile terminal and an image display apparatus for displaying a variety of information so that the user can conveniently use the image display apparatus.

In accordance with an aspect of the present invention, there is provided a method of operating a mobile terminal, the method comprising: receiving a command for sharing contents displayed on an image display apparatus, displaying an image based on the contents, and displaying an input window. And transmitting a signal based on the information input in the input window.

According to an aspect of the present invention, there is provided a method of operating an image display apparatus, the method including displaying a content including a plurality of items on a display unit, and selecting at least one item from among the plurality of items. Changing a display state of a screen displayed on the display unit based on the selected item; receiving an input signal related to the selected item from the mobile terminal; and displaying a feedback image corresponding to the input on the display unit It includes.

In accordance with an aspect of the present invention, there is provided a method of operating a mobile terminal, the method comprising: receiving a command for sharing content displayed on an image display device, displaying an image based on the content, and detecting rotation; And varying the display state of the image, wherein the changing the display state further includes displaying information related to the content when the screen of the mobile terminal is rotated such that the length in the vertical direction is greater than the length in the horizontal direction. It features.

According to an embodiment of the present invention, by sharing various contents and information between the portable terminal and the image display device, the user can manage and utilize the contents and information more conveniently and variously.

Meanwhile, various user interfaces may be provided in the portable terminal and the image display device, thereby increasing user convenience.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
FIG. 2 is an internal block diagram of the controller of FIG. 1.
3 is a view showing the operation of the remote control device of FIG.
Figure 4a is a perspective view of a remote control device according to an embodiment of the present invention, Figure 4b is an internal block diagram of the remote control device.
5 is an internal block diagram of a portable terminal according to an embodiment of the present invention.
6 is a diagram illustrating a front surface of a portable terminal according to an embodiment of the present invention.
7 to 18 are views for explaining various examples of a method of operating a mobile terminal and an image display device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

On the other hand, the video display device described in the present specification is an intelligent video display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function, but with the addition of the Internet function, the handwriting type input device, touch screen or It can be equipped with a more convenient interface such as a space remote control. In addition, by being connected to the Internet and a computer with the support of a wired or wireless Internet function, it is possible to perform functions such as e-mail, web browsing, banking or gaming. A standardized general-purpose OS can be used for these various functions.

That is, in the image display apparatus described in the present invention, various applications can be freely added or deleted on the general-purpose OS kernel, and thus various user-friendly functions can be performed. For example, it may be a smart TV.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the image display apparatus 100 according to an exemplary embodiment of the present invention may include a broadcast receiver 105, an external device interface 135, a storage 140, a user input interface 150, The controller 170 may include a display unit 180, an audio output unit 185, and a power supply unit 190. The broadcast receiving unit 105 may include a tuner 110, a demodulator 120, and a network interface unit 130. Among them, the tuner 110 and the demodulator 120 may be provided with the network interface unit 130 selectively.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal CVBS / SIF output from the tuner 110 may be directly input to the controller 170.

In addition, the tuner 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a digital video broadcasting (DVB) scheme.

Meanwhile, the tuner 110 may sequentially select RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna and convert them to intermediate frequency signals or baseband video or audio signals. have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs an 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulation unit 120 may perform channel decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulator 120 may output a stream signal TS after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

On the other hand, the demodulator 120 described above can be provided separately according to the ATSC system and the DVB system. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulator 120 may be input to the controller 170. After performing demultiplexing, image / audio signal processing, and the like, the controller 170 outputs an image to the display unit 180 and outputs an audio to the audio output unit 185.

The external device interface unit 135 may connect the external device to the image display device 100. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 may be connected to an external device such as a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), or the like by wire / wireless. The external device interface unit 135 transmits an image, audio, or data signal input from the outside through the connected external device to the controller 170 of the image display device 100. In addition, the controller 170 may output an image, audio, or data signal processed by the controller 170 to a connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI so that video and audio signals of an external device can be input to the video display device 100. (Digital Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, RGB terminal, D-SUB terminal and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The image display device 100 may communicate with Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance (DLNA). Depending on the specification, it can be networked with other electronic devices.

In addition, the external device interface unit 135 may be connected through at least one of the various set top boxes and the various terminals described above, and perform input / output operations with the set top box.

Meanwhile, the external device interface unit 135 may receive an application or a list of applications in a neighboring external device and transmit the received application or list to the controller 170 or the storage 140.

The network interface unit 130 provides an interface for connecting the image display apparatus 100 to a wired / wireless network including an internet network. The network interface unit 130 may include an Ethernet terminal for connecting to a wired network, and for connecting to a wireless network, a WLAN (Wi-Fi) or Wibro (Wireless). Broadband, Wimax (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA) communication standards, and the like may be used.

Meanwhile, the network interface unit 130 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 130 may select and receive a desired application from among applications that are open to the public through the network.

The storage 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal processed video, audio, or data signal.

In addition, the storage 140 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface 135 or the network interface 130. In addition, the storage 140 may store information on a predetermined broadcast channel through a channel storage function.

In addition, the storage 140 may store an application or a list of applications input from the external device interface 135 or the network interface 130.

The storage unit 140 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), It may include at least one type of storage medium such as RAM, ROM (EEPROM, etc.). The image display apparatus 100 may reproduce and provide a content file (video file, still image file, music file, document file, application file, etc.) stored in the storage 140 to a user.

1 illustrates an embodiment in which the storage unit 140 is provided separately from the control unit 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be powered on / off, channel selection, and screen from the remote controller 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method. The controller may receive and process a user input signal or a control signal such as a setting, or transmit a control signal from the controller 170 to the remote controller 200.

In addition, for example, the user input interface unit 150 may transmit a user input signal or a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170. have.

In addition, for example, the user input interface unit 150 may transmit a user input signal or a control signal input from a sensing unit (not shown) that senses a user's gesture to the controller 170 or from the controller 170. The signal of may be transmitted to a sensing unit (not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110, the demodulator 120, or the external device interface unit 135, and outputs a video or audio signal. You can create and output.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. In addition, the voice signal processed by the controller 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the controller 170 may control overall operations of the image display apparatus 100. For example, the controller 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.

In addition, the controller 170 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150. In particular, the user may access the network to download the desired application or application list into the image display apparatus 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The controller 170 allows the channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

As another example, the controller 170 may receive an external device image playback command received through the user input interface unit 150 from an external device, for example, a camera or a camcorder, input through the external device interface unit 135. The video signal or the audio signal may be output through the display unit 180 or the audio output unit 185.

The controller 170 may control the display 180 to display an image. For example, a broadcast image input through the tuner 110, an external input image input through the external device interface unit 135, or an image input through the network interface unit or an image stored in the storage unit 140 may be displayed on a display unit ( 180) to control the display. In this case, the image displayed on the display unit 180 may be a still image or a video, and may be a 2D image or a 3D image.

Meanwhile, when entering an application view item, the controller 170 may control to display an application or a list of applications that can be downloaded from the image display apparatus 100 or from an external network.

The controller 170 may control to install and run an application downloaded from an external network along with various user interfaces. In addition, by selecting a user, an image related to an executed application may be controlled to be displayed on the display unit 180.

Meanwhile, when a search word related to the displayed image is input, the controller 170 controls to display the collected related information on the display unit 180, and when there is a zoom in or zoom out input from the remote controller 200, Control to display the related information by zooming in or out of the related information. The zoom in or zoom out input may be performed by moving the remote controller 200 to approach the display unit 180 or to move away from the display unit 180.

Meanwhile, when the displayed image is a video, the controller 170 may control to stop the playback of the video when a search word is input. In this case, the object indicating the reproduction of the image may be displayed on the display unit 180.

Meanwhile, the controller 170 may control to display a keyboard on the display unit 180 for input of a search word, and when a character in the keyboard displayed by the user's selection is selected, the character is controlled to be input. can do.

On the other hand, when receiving a character selected by the button in the image display apparatus 200, the controller 170 may control that the character is input based on the received signal.

In addition, when a partial region in the displayed image is selected by the user, the controller 170 may control that a search word corresponding to the image in the selected region is input. For example, an image in the selection area may be searched in the image display apparatus or on a network, and an image similar to the image may be searched to identify the corresponding content and search terms may be derived. Alternatively, search terms may be derived by using meta data added to an image in the selection area and using related information included in the meta data.

Meanwhile, the controller 170 displays a plurality of items in which the related information is arranged in one region of the display unit 180 to display a search result, and displays the related information about the selected item among the displayed items. Control to display in other areas. These items may be music items, video items, web items, map items, application items, and the like. These items may be added or deleted according to a user's setting, and the order of items displayed according to the priority may vary. It is possible.

For example, when an application item is selected among the items, the application information may be controlled to display application information that can be downloaded from the image display apparatus 100 or from an external network.

The controller 170 may control to install and run an application downloaded from an external network along with various user interfaces. An image related to an executed application may be controlled to be displayed on the display unit 180.

Meanwhile, the controller 170 may control to display an input window for inputting a search word. The input window may be displayed in an area different from the image displayed on the display unit 180 or may be overlaid on the image. Can be displayed.

Meanwhile, the controller 170 may control to display the previously displayed image on the display unit 180 when there is an exit input of the related information display or an exit input of the zoom in or zoom out display. In this case, it is also possible to display a playback object indicating playback of the image on the display unit 180.

On the other hand, although not shown in the figure, it may be further provided with a channel browsing processing unit for generating a thumbnail image corresponding to the channel signal or the external input signal. The channel browsing processor may receive a stream signal TS output from the demodulator 120 or a stream signal output from the external device interface 135, extract a video from the input stream signal, and generate a thumbnail image. Can be. The generated thumbnail image may be input as it is or encoded to the controller 170. In addition, the generated thumbnail image may be encoded in a stream form and input to the controller 170. The controller 170 may display a thumbnail list including a plurality of thumbnail images on the display unit 180 using the input thumbnail image. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of the plurality of broadcast channels.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the controller 170, or an image signal, data signal, etc. received from the external device interface unit 135 into R, G, and B signals, respectively. Generate a drive signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the controller 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs a voice signal. The voice output unit 185 may be implemented by various types of speakers.

On the other hand, a photographing unit (not shown) for photographing a user can be further provided. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. The image information photographed by the photographing unit (not shown) is input to the controller 170.

Meanwhile, in order to detect a gesture of a user, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the image display apparatus 100. have. The signal detected by the sensing unit (not shown) may be transmitted to the controller 170 through the user input interface unit 150.

The controller 170 may detect a gesture of a user by combining or combining an image captured by a photographing unit (not shown) or a detected signal from a sensing unit (not shown).

The power supply unit 190 supplies power to the entire image display apparatus 100. In particular, power may be supplied to the controller 170, which may be implemented in the form of a System On Chip (SOC), a display unit 180 for displaying an image, and an audio output unit 185 for audio output. Can be.

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. Meanwhile, for example, when the display unit 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM operation may be further provided for driving of variable brightness or dimming. It may be.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. To this end, the remote control apparatus 200 may use RF (Radio Frequency) communication, infrared (IR) communication, Bluetooth, Bluetooth (UWB), ZigBee (ZigBee) method and the like.

In addition, the remote control apparatus 200 may receive an image, an audio or a data signal output from the user input interface unit 150, display it on the remote control apparatus 200 or output an audio or vibration.

The video display device 100 described above is a fixed type of ATSC (8-VSB) digital broadcasting, DVB-T (COFDM) digital broadcasting, ISDB-T (BST-OFDM) digital broadcasting, and the like. It may be a digital broadcast receiver capable of receiving at least one.

Meanwhile, the image display apparatus described herein is an image display apparatus in which the display unit 180 and the audio output unit 185 shown in FIG. 1 are excluded, and the display unit 180 and the audio output are provided through wireless communication. It may be of a wireless type, which transmits and receives data with the unit 185.

Meanwhile, a block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 that is actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

Meanwhile, the image display apparatus 100 does not include the tuner 110 and the demodulator 120 shown in FIG. 1, and receives the image content through the network interface 130 or the external device interface 135. Can be reproduced.

The image display apparatus 100 is an example of an image signal processing apparatus which performs signal processing of an image stored in an apparatus or an input image. As another example of the image signal processing apparatus, a set top box without the display unit 180 and the audio output unit 185 shown in FIG. 1, the above-described DVD player, Blu-ray player, game device, computer, etc. may be further illustrated. Can be.

FIG. 2 is an internal block diagram of the controller of FIG. 1.

Referring to the drawings, the control unit 170 according to an embodiment of the present invention, the demultiplexer 310, the image processor 320, the OSD generator 340, the mixer 350, the frame rate converter 355 ), And a formatter 360. In addition, the apparatus may further include a voice processor (not shown) and a data processor (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when an MPEG-2 TS is input, it may be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110, the demodulator 120, or the external device interface unit 135.

The image processor 320 may perform image processing of the demultiplexed image signal. To this end, the image processor 320 may include an image decoder 325 and a scaler 335.

The image decoder 325 decodes the demultiplexed image signal, and the scaler 335 performs scaling to output the resolution of the decoded image signal on the display unit 180.

The video decoder 325 can include a decoder of various standards.

For example, when the demultiplexed video signal is an encoded video signal of MPEG-2 standard, it may be decoded by an MPEG-2 decoder.

Also, for example, when the demultiplexed video signal is a digital video broadcasting (DMB) scheme or an encoded video signal of H.264 standard according to DVB-H, it may be decoded by an H.264 decoder.

On the other hand, the video signal decoded by the image processor 320 is input to the mixer 350.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, a signal for displaying various types of information on a screen of the display unit 180 as a graphic or text may be generated based on a user input signal or a control signal. The generated OSD signal may include various data such as a user interface screen, various menu screens, widgets, and icons of the image display apparatus 100.

For example, the OSD generator 340 may generate a signal for displaying broadcast information based on subtitles or EPGs of a broadcast image.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal processed by the image processor 220. The mixed signal is provided to the formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD may be overlaid and displayed on the broadcast video or the external input video.

The frame rate converter (FRC) 355 may convert the frame rate of the input video. For example, a 60Hz frame rate is converted to 120Hz or 240Hz. When converting a frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame or insert a third frame predicted from the first frame and the second frame between the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or three predicted frames. On the other hand, it is also possible to maintain the input frame rate without additional conversion.

The formatter 360 receives the output signal of the frame rate converter 355 and changes the format of the signal to be suitable for the display unit 180 and outputs the signal. For example, the R, G, B data signals may be output, and the R, G, B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

The voice processing unit (not shown) in the controller 170 may perform voice processing of the demultiplexed voice signal. To this end, the voice processing unit (not shown) may include various decoders.

The speech processing unit (not shown) in the controller 170 may decode the demultiplexed speech signal if it is an encoded speech signal. For example, the demultiplexed speech signal may be decoded by an MPEG-2 decoder, or an MPEG 4 decoder, or an AAC decoder, or an AC-3 decoder.

Also, the voice processing unit (not shown) in the controller 170 may process a base, a treble, a volume control, and the like.

The data processor (not shown) in the controller 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted in each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme, and may include DVB-Service Information (DVB-SI) in the case of the DVB scheme. . The ATSC-PSIP information or the DVB-SI information may be information included in the aforementioned stream, that is, the header (4 bytes) of the MPEG-2 TS.

Meanwhile, a block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

3 is a view showing the operation of the remote control device of FIG.

Referring to the drawings, the remote control apparatus 200 may transmit / receive a signal with the image display apparatus 100 according to an RF communication standard or an IR communication standard.

FIG. 3A illustrates that a pointer 205 corresponding to the remote controller 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 3 (b)), front and back (Fig. 3 (c)). The pointer 205 displayed on the image display apparatus 100 corresponds to the movement of the remote control apparatus 200. The remote control apparatus 200 may be referred to as a spatial remote controller because the pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure.

3B illustrates that when the user moves the remote control apparatus 200 to the left side, the pointer 205 displayed on the image display apparatus 100 also moves to the left side correspondingly. Information about the movement of the remote control apparatus 200 detected through the sensor of the remote control apparatus 200 is transmitted to the image display apparatus 100. The image display apparatus 100 can calculate the coordinates of the pointer 205 from the information on the motion of the remote control device 200. [ The image display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.

FIG. 3C illustrates a case in which the user moves the remote control apparatus 200 away from the display unit 180 while pressing a specific button in the remote control apparatus 200. As a result, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in to be enlarged and displayed. On the contrary, when the user moves the remote controller 200 to be closer to the display unit 180, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed out and reduced. On the other hand, when the remote control apparatus 200 moves away from the display unit 180, the selection area is zoomed out, and when the remote control apparatus 200 approaches the display unit 180, the selection area may be zoomed in.

On the other hand, while pressing a specific button in the remote control device 200 can recognize the up, down, left and right movement. That is, when the remote control apparatus 200 moves away from or approaches the display unit 180, the up, down, left, and right movements are not recognized, and only the front and back movements may be recognized. In a state where a specific button in the remote controller 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movements of the remote controller 200.

Meanwhile, the moving speed or the moving direction of the pointer 205 may correspond to the moving speed or the moving direction of the remote control apparatus 200.

The pointer in the present specification refers to an object displayed on the display unit 180 in response to the operation of the remote control apparatus 200. Thus, the pointer 205 may be an object of various shapes in addition to the arrow shape shown in the drawing. For example, the concept may include a point, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 205 may be displayed corresponding to any one of the horizontal axis and the vertical axis of the display unit 180, or may be displayed corresponding to a plurality of points such as a line and a surface. Do.

4A is a diagram illustrating an example of a remote control apparatus and a space remote control 201 according to an embodiment of the present invention.

Referring to the drawings, the spatial remote control 201 according to an embodiment of the present invention may include various input keys or input buttons.

For example, the spatial remote control 201 may include an ok key 291, a menu key 292, a four-way key 293, a channel adjustment key 294, and a volume adjustment key 296. have.

For example, the ok key 291 may be used to select a menu or item, the menu key 292 may be used to display a predetermined menu, and the four-way key 293 may move up or down the pointer or indicator. It can be used to move up, down, left and right, the channel adjustment key 294 can be used to adjust the channel up and down, and the volume adjustment key 296 can be used to adjust the volume up and down.

The spatial remote control 201 may further include a back key 297 and a home key 298. For example, the back key 297 may be used when moving to the previous screen, and the home key 298 may be used when moving to the home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. To this end, the confirmation key 291 can be implemented in the form of a wheel key. That is, when the confirmation key 291 is pressed, it is used as a menu or item selection, and when the confirmation key 291 is scrolled up and down, display screen scrolling or list page switching may be performed.

In detail, when an image larger than the size of the display is displayed on the display unit 180, when the confirmation key 291 is scrolled to search for the corresponding image, an image area not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, when the confirmation key 291 is scrolled, the previous page or the next page of the current page may be displayed.

The scroll function may be provided as a key other than the confirmation key 291.

On the other hand, the four-way key 293, in the circular type, as shown in the upper, lower, left, right keys may be arranged in four directions, respectively. Meanwhile, a touch input to the four-way key 293 may also be possible. For example, when there is a touch operation from an up key to a down key in the four-way key 293, a set function may be input or performed according to the corresponding touch input.

4B is an internal block diagram of the remote control device of FIG. 1.

Referring to the drawings, the remote control apparatus 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, The controller 280 may be included.

The wireless communication unit 225 transmits and receives a signal with the image display device 100. In the present embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving a signal with the image display device 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving a signal with the image display device 100 according to the IR communication standard.

In the present embodiment, the remote control apparatus 200 transmits a signal containing information on the movement of the remote control apparatus 200 to the image display apparatus 100 through the RF module 221. In addition, the remote control apparatus 200 may receive a signal transmitted from the image display apparatus 100 through the RF module 221. In addition, the remote control apparatus 200 may transmit a command regarding power on / off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as necessary.

The user input unit 235 may be configured as a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 by manipulating the user input unit 235. When the user input unit 235 includes a hard key button, the user may input a command related to the image display device 100 to the remote control apparatus 200 through a push operation of the hard key button. When the user input unit 235 includes a touch pad, a user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by touching the touch pad. In addition, the user input unit 235 may include various kinds of input means that the user can operate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 may sense information about the movement of the remote controller 200. For example, the gyro sensor 241 may sense information about the operation of the remote control apparatus 200 based on the x, y, and z axes. The acceleration sensor 243 may sense information about a moving speed of the remote controller 200. On the other hand, the distance measuring sensor may be further provided, whereby the distance to the display unit 180 can be sensed.

The output unit 250 may output a video or audio signal corresponding to a manipulation of the user input unit 235 or a signal transmitted from the image display apparatus 100. The user may recognize whether the user input unit 235 is manipulated or whether the image display device 100 is controlled through the output unit 250.

For example, the output unit 250 may include a LED module 251 that is turned on when the user input unit 235 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, and a vibration module generating vibration. 253, a sound output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 may reduce power waste by stopping the power supply when the remote controller 200 does not move for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control apparatus 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control apparatus 200. If the remote control device 200 transmits and receives a signal wirelessly through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band. Send and receive The control unit 280 of the remote control device 200 stores in the storage unit 270 information on a frequency band for transmitting and receiving a signal wirelessly with the image display device 100 paired with the remote control device 200. Reference may be made.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The controller 280 transmits a signal corresponding to a predetermined key manipulation of the user input unit 235 and a signal corresponding to the movement of the remote controller 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100 can be sent.

5 is an internal block diagram of a portable terminal according to an embodiment of the present invention, and FIG. 6 is a diagram illustrating a front surface of the portable terminal according to an embodiment of the present invention.

Referring to FIG. 5, the mobile terminal 500 includes a user interface unit 510, an audio / video input unit 520, a network interface unit 530, an external device interface unit 535, and a sensor. The unit 540 may include a storage unit 550, a control unit 560, a display unit 570, an audio output unit 580, and a power supply unit 590. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

On the other hand, the mobile terminal described herein may be, for example, a smartphone as shown in (a) of FIG. 6, a tablet PC as shown in (b) of FIG. 6.

In addition, the portable terminal described in the present specification may be a tablet computer, a mobile phone, a smart phone, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), or a digital broadcasting terminal. , Navigation, and the like.

 On the other hand, the portable terminal described herein is connected to the Internet and a computer with the support of a wired or wireless Internet function, it is also possible to perform functions such as email, web browsing, banking or gaming. In addition, voice and video call functions can be performed, and the call mode can be performed by using an Internet network, a mobile communication network, etc. according to Voice over Internet Protocol (VoIP).

The user input unit 510 generates key input data input by the user for controlling the operation of the portable terminal. The user input unit 510 may be configured of a key pad, a switch, a touch screen (static pressure / capacitance), etc., which may receive a command or information by a user's push or touch operation. In addition, the user input unit 510 may be configured as a jog wheel for rotating a key, a jog method or a manipulation method such as a joystick, or a finger mouse.

The A / V input unit 520 is for inputting an audio signal or a video signal, and may include a camera and a microphone. The camera processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 570.

The image frame processed by the camera may be stored in the storage unit 550 or transmitted to the outside through the network interface unit 530 or the external device interface unit 535. Two or more cameras may be provided according to the configuration aspect of the terminal.

The microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data.

The network interface unit 530 provides an interface for connecting the mobile terminal 500 to a wired / wireless network including an internet network.

The network interface unit 530 may transmit or receive data with another user or another electronic device through the connected network or another network linked to the connected network. In particular, some content data stored in the mobile terminal 500 may be transmitted to a user selected from another user or another electronic device registered in the mobile terminal 500 or the selected electronic device.

Meanwhile, the network interface unit 530 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 530 may select and receive a desired application from among applications that are open to the public through the network.

Meanwhile, the network interface unit 530 may be connected to a mobile communication network and include a mobile communication unit for voice and video call. The mobile communication unit transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

In addition, the mobile terminal 500 may receive a signal related to broadcast through a wired or wireless Internet network, and may further include a separate broadcast receiver (not shown) for broadcast reception.

The broadcast receiver may receive at least one of a broadcast signal and broadcast related information from the outside, and may include a tuner, a demodulator, a demultiplexer, a decoder, and the like, for receiving the signal and processing the signal.

The external device interface unit 535 may connect the external device to the portable terminal 500. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 535 may be connected to an external device such as a TV, a DVD (Digital Versatile Disk), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), a refrigerator, or the like by wire or wireless. have. The external device interface unit 535 transmits an image, audio or data signal input from the outside through the connected external device to the controller 560 of the portable terminal 500. In addition, the controller 560 may output an image, audio, or data signal processed by the controller 560 to a connected external device. To this end, the external device interface unit 535 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit may use a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI to input video and audio signals from an external device to the mobile terminal 500. Digital Visual Interface (HDMI) terminal, High Definition Multimedia Interface (HDMI) terminal, RGB terminal, D-SUB terminal and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The mobile terminal 500 may include, for example, Near Field Communication (NFC), Bluetooth (Bluetooth), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, It can be networked with other electronic devices according to various communication standards such as DLNA (Digital Living Network Alliance).

In addition to the external device described above, the external device interface unit 535 serves as an interface with all external devices connected to the portable terminal 500. Examples of the external device connected to the portable terminal 500 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The external device interface unit 535 may receive data from such an external device or receive power and transfer the data to each component inside the mobile terminal 500 so that the data inside the mobile terminal 500 may be transmitted to the external device. Can be.

Meanwhile, the external device interface unit 535 may receive an application or a list of applications in a neighboring external device and transmit the received application or application list to the controller 560 or the storage unit 550.

Meanwhile, the controller 560 transmits a control signal by a user's command or program to another electronic device connected through the network interface unit 530 or the external device interface unit 535 or receives a control signal received from an allowed electronic device. You can perform a command based on that. For example, it is possible to control an image display device, perform a reservation operation using a PC connected to a home network, check the contents of a smart refrigerator, and receive various signals such as a message or a command from a smart phone of a family member. .

The sensor unit 540 detects the current state of the portable terminal 500 such as the position of the portable terminal 500, the presence or absence of a user contact, and generates a sensing signal for controlling the operation of the portable terminal 500.

The sensor unit 540 may include a detection sensor, a pressure sensor, and a motion sensor. The sensor detects the presence or absence of an object approaching the portable terminal 500 or an object present in the vicinity of the portable terminal 500 without mechanical contact. The detection sensor can detect the proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance. Two or more detection sensors may be provided according to the configuration aspect.

The pressure sensor may detect whether pressure is applied to the mobile terminal 500 and the magnitude of the pressure. The pressure sensor may be installed at a portion of the portable terminal 500 that requires the detection of pressure according to the use environment. If the pressure sensor is installed in the display unit 570, a touch input through the display unit 570 and a pressure touch input to which a greater pressure is applied than the touch input may be identified according to a signal output from the pressure sensor. Can be. In addition, according to the signal output from the pressure sensor, it can also know the magnitude of the pressure applied to the display unit 570 when the pressure touch input.

The motion sensor detects the position or movement of the portable terminal 500 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used in a motion sensor is an element that converts an acceleration change in one direction into an electrical signal, and a gyro sensor can detect a return direction with respect to an angular velocity and a reference direction, and the operation of the mobile terminal 500 is performed. Information about may be sensed based on the x, y, and z axes. The acceleration sensor may sense information regarding a moving speed of the portable terminal 500 and the like. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The storage unit 550 may store a program, a platform, and an application for each signal processing and control in the controller 560, or may store a signal processed image, audio, or data signal.

Meanwhile, the mobile terminal 500 may provide a user with a content file (video file, still image file, music file, document file, application file, etc.) stored in the storage unit 550.

In addition, the storage unit 550 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 535 or the network interface unit 530.

The storage unit 550 may be, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory). Etc.), RAM, and ROM (EEPROM, etc.) may include at least one type of storage medium.

5 illustrates an embodiment in which the storage unit 550 is provided separately from the control unit 560, the scope of the present invention is not limited thereto. The storage unit 550 may be included in the controller 560.

The controller 560 may control overall operations of the portable terminal 500. For example, the controller 560 may control the portable terminal 500 by a user command or an internal program input through the user interface 510. In particular, it is possible to connect to the network so that the user can download the desired application or application list into the mobile terminal 500.

The controller 560 allows an image or an audio to be output through the display unit 570 or the audio output unit 580 based on the received signal.

As another example, the controller 560 may be provided from an external device, for example, a camera or a camcorder, input through the external device interface unit 535 according to an external device image playback command received through the user interface unit 510. The video signal or the audio signal may be output through the display unit 570 or the audio output unit 580.

Meanwhile, the controller 560 may control the display unit 570 to display the video of the call counterpart and the video of the user according to the user's setting in the video call mode, and to output a voice based on the received voice signal of the call counterpart. The audio output unit 580 may be controlled to output.

In addition, the controller 560 may control to reproduce the content. In this case, the content may be content stored in the mobile terminal 500, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

In addition, the controller 560 may determine whether the touch input corresponds to a character input such as alphabet, number, or symbol based on the pattern of the touch input signal. The controller 560 may check a character corresponding to the trajectory of the touch input based on the database. The database includes Korean, English, Chinese, Japanese, numbers, symbols, and the like, and may be stored in the controller 560 or the storage 550.

The controller 560 may control to install and run an application downloaded from an external network along with various user interfaces. In addition, by selecting a user, an image related to an application to be executed may be controlled to be displayed on the display unit 570.

The platform of any one of the mobile terminal 500 according to the embodiments of the present invention may be equipped with OS-based software to perform the various operations described above. The platform may be provided in the form of a program in the control unit or a separate processor, or may be stored in the storage unit.

The platform of any one of the portable terminals according to the embodiments of the present invention may include an OS kernel, a driver on the OS kernel, middleware, a framework, and an application layer. It may include.

The OS kernel may be implemented as a kernel based on various operating systems (OS), such as Unix-based (Linux) and Windows-based. Also, the OS kernel is an open OS kernel and may be general purpose that can be used in other electronic devices.

The display unit 570 may display an image signal, a data signal processed by the controller 560, or an image signal, data signal, etc. received by the network interface unit 530 or the external device interface unit 535, respectively. The drive signal is generated by converting into a B signal.

The display unit 570 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, or the like.

The display unit 570 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 580 outputs audio data received or stored in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the audio output unit 580 outputs a sound signal related to a function performed in the portable terminal 500, for example, a call signal reception sound and an effect sound. The audio output unit 180 may include a speaker, a buzzer, and the like.

On the other hand, the power supply unit 590 supplies the power throughout the portable terminal 500.

Meanwhile, the portable terminal 500 having the above-described configuration described with reference to FIG. 5 may include a wired / wireless communication system and a satellite-based communication system, and may transmit data through a frame or a packet. It can be configured to be operable in a communication system that is present.

7 to 14 are views for explaining various examples of an operation method of a mobile terminal and an image display device according to an embodiment of the present invention.

7 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention.

First, a portable terminal according to an embodiment of the present invention receives a command for sharing contents displayed on an image display device (S710).

Here, a command for sharing content may be input in various ways.

For example, the command for sharing the content may be to select a sharing menu displayed on the display unit 570 of the mobile terminal 500, or snapping at least one surface of the mobile terminal 500 toward the user. It may be a gesture.

The snatching operation has an advantage in that a user can input a content sharing command without moving his / her eyes while using the content.

Referring to FIG. 11, a snatching operation in which one side 1120 of the mobile terminal is closer to the user after the snatching gesture is performed than the one side 1120 of the portable terminal before the snatching gesture may be confirmed.

Meanwhile, the method of operating a mobile terminal according to an embodiment of the present invention may further include transmitting a content playback command to the video display device. That is, the content may be displayed on the image display device in order to use the content on a large screen of the image display device, and then the portable terminal may be used if necessary.

Thereafter, the mobile terminal 500 receiving the command for sharing the contents displays an image based on the contents (S720).

In this case, the image based on the content may be an image in which the display state of the content is changed or a part of the entire image of the content.

Although not shown in FIG. 7, the method may further include a step of network connection with the image display apparatus and transmitting and receiving data for content sharing. The data for content sharing may be content data itself, or may be a title of a content, a URL in which the content is stored, playback timing information, and authentication information.

The content displayed on the image display apparatus may include a plurality of items, and the image based on the content may be an image related to any one item of the plurality of items.

In particular, when any item of the content is selected, the image based on the content may be an image corresponding to the selected item.

For example, when one application is selected when the content is an application store, an image related to the selected application may be displayed.

Hereinafter, the process of purchasing an application will be described as an example, but the present invention is not limited thereto.

Thereafter, an input window corresponding to the displayed image is displayed (S730).

That is, in the case of the previous application store example, an application purchase window, a payment information input window, or an identity information input window may be displayed, and the information may include payment information or user identification information.

When the user's input is completed, a signal based on the information input in the input window is transmitted to the video display device (S740).

Handheld terminals are personalized electronics that offer greater security and privacy protection than common electronics. Therefore, various payment methods and security methods using the mobile terminal have been studied and can be used for purchase. In addition, the present invention is characterized in that the portable terminal and the image display device display a variety of information by using two devices, it is possible to use the portable terminal for inputting information for purchase.

12 illustrates a process of purchasing an application for a TV using a mobile terminal.

Referring to FIG. 12, the purchase page 1200 displayed on the image display apparatus is loaded to the mobile terminal through the above-described snapping operation. When the user selects the purchase item 1210, the mobile terminal displays an input window 1221 for inputting information necessary for purchase on the screen.

In this case, a tool useful for input may be further displayed, such as the screen keyboard 1222. In general, information for purchase is often composed of a combination of alphanumeric, and video display devices have been difficult to input alphanumeric information, compared to PCs and mobile terminals. There is an advantage that you can easily enter information.

Thereafter, the portable terminal may display information 1230 corresponding to the user's input, such as payment completion.

On the other hand, the method of operating a portable terminal according to an embodiment of the present invention further comprises the step of connecting to a server, the transmission of the signal and various data may be via the server. That is, the video display device may be directly connected to a network to transmit and receive signals and data, and may also be implemented through a server.

8 is a flowchart of a method of operating an image display apparatus according to an exemplary embodiment.

The image display apparatus displays the content including the plurality of items on the display unit 180 (S810).

On the other hand, the command to play the displayed content may be input through a remote control device, a local key provided in the image display device, a user's touch or gesture.

Alternatively, the method may further include receiving a content playback command from the mobile terminal, and display content corresponding thereto.

For example, when the user selects a TV application store access menu from among menu icons of the mobile terminal, the image display device may access the TV application store.

After accessing the TV application store, the application store may be displayed as shown in FIG.

Subsequently, at least one item 1011 of the plurality of items 1010 is selected by one of various means such as a remote controller, a portable terminal, a user's touch or input through a gesture (S820).

That is, the selection input for at least one of the plurality of items may be input from various means such as a remote control device or the portable terminal.

If there is a selection input, the display state of the screen displayed on the display unit 180 is changed based on the selected item (S830).

In operation S830, at least one of a size, a color, and a transparency of the selected item may be changed. Alternatively, as shown in FIG. 10, a highlight effect may be applied to the selected item.

In operation S830, the display state variable step may further display an image corresponding to the selected item. For example, an image corresponding to the selected item may be displayed in the form of a pop-up window.

Alternatively, in step S830 of changing the display state, the screen may be switched to an image corresponding to the selected item. For example, as shown in (b) of FIG. 10, it may be switched to the purchase screen 1020 of the selected item.

Thereafter, an input signal related to the selected item is received from the portable terminal (S840). The input signal may include at least one of input, payment information, or user identity information for controlling the selected item.

Thereafter, a feedback image corresponding to the input is displayed on the display unit 180 (S850).

Here, the feedback image may include result information 1310 according to the input. The result information 1310 may include information for confirming the input contents of the user or for notifying the completion of the process and the process corresponding to the input of the user.

On the other hand, the operation method of the image display apparatus according to an embodiment of the present invention further comprises the step of connecting to the server, the transmission of the signal and various data may be via the server. That is, the mobile terminal can be directly connected to the network to transmit and receive signals and data, as well as through a server.

Meanwhile, according to an embodiment of the present invention, when the portable terminal and the image display apparatus use the application store contents, the portable terminal and the image display apparatus may operate in cooperation with each other in the order of FIGS. 10, 11, 12, and 13.

14 illustrates an example of using calendar contents through a mobile terminal and an image display apparatus.

Referring to FIG. 14, the image display apparatus 100 displays a lot of information, for example, a schedule 1410 for one month, and the mobile terminal 500 selects an item selected from the displayed schedule 1410, for example, 7. The detailed schedule 1420 of the month 7 may be used as an input means for checking or updating.

That is, the present invention can increase the user's convenience by displaying the information displayed by interworking the portable terminal and the image display device on a more suitable device.

FIG. 9 is a signal flow diagram between the mobile terminal 500 and the image display apparatus 100. Since it has already been described with reference to FIGS. 7 and 8, it will be briefly described.

The portable terminal 500 may transmit a control command, for example, a content playback command, an internet access command, or the like to the image display apparatus 100 (S910).

The image display apparatus 100 displays predetermined contents, and when a user who uses the contents is input through the large screen of the image display apparatus 100, a command for sharing the contents is input. (S920).

The mobile terminal 500 may receive information and data for content sharing from the image display apparatus 100 (S930) and display an input window when an image and input based on the content are required.

When the user's input is completed, the portable terminal 500 transmits to the image display apparatus 100 (S940).

15 to 18 are diagrams for describing various examples of an operation method of a mobile terminal and an image display apparatus according to an embodiment of the present invention.

Referring to the drawings, a command for sharing the content 1610 displayed on the image display device is received (S1510). Here, the command for sharing the content may be a gesture of pulling at least one surface of the portable terminal toward the user. .

The portable terminal displays an image 1710 based on the content. [S1520] Here, the image based on the content is an image in which a display state such as the size and resolution of the content is changed, or a part of the entire image of the content. Can be.

Then, when the rotation of the portable terminal is detected (S1530), the display state of the image is changed (S1540).

17, when the rotation is such that the screen of the mobile terminal is rotated such that the length in the vertical direction is greater than the length in the horizontal direction, the information 1730 related to the content may be further displayed.

In this case, the information 1730 related to the content may be displayed in the form of a popup, or may be displayed after reducing the size of the area where the content is displayed.

That is, the reduced image 1720 of the content may be displayed in a predetermined area, and the information 1730 related to the content may be displayed in the remaining area.

The information 1730 related to the content may be a real-time search, shopping, recommendation item, or the like for the content currently being used.

Conversely, when the rotation is such that the screen of the mobile terminal is rotated such that the length in the vertical direction is smaller than the length in the horizontal direction, the display state variable step S1540 may display the content on the full screen.

Meanwhile, even when a plurality of contents such as a live broadcast video 1810 and a social network application or a widget 1820 are displayed on the video display device as illustrated in FIG. 18, the mobile terminal may have a different screen configuration according to the arrangement state. have.

For example, when the portable terminal is vertically rotated, the display state of the content corresponding to the live broadcast image 1830 at the top and the social network application or the widget 1840 may be changed and displayed at the bottom.

On the other hand, when the rotation of the portable terminal is detected, it is also possible to display the network-connected electronic devices, available content items.

According to an embodiment of the present invention, by sharing various contents and information between the portable terminal and the image display device, the user can manage and utilize the contents and information more conveniently and variously.

Meanwhile, various user interfaces may be provided in the portable terminal and the image display device, thereby increasing user convenience.

The operation method of the mobile terminal and the image display apparatus according to the present invention is not limited to the configuration and method of the embodiments described as described above, but the embodiments are all of the embodiments so that various modifications can be made. Or some may be selectively combined.

On the other hand, the operating method of the portable terminal and the image display apparatus of the present invention can be embodied as processor readable codes on a processor-readable recording medium included in the portable terminal and the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. . The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Receiving a command for sharing contents displayed on the image display apparatus;
Displaying an image based on the content;
Displaying an input window corresponding to the image; And
Transmitting a signal based on the information input in the input window to the image display device. The method of claim 1,
And transmitting a content playback command to the video display device. The method of claim 1,
And a command for sharing the content is a gesture that pulls at least one surface of the portable terminal toward the user. The method of claim 1,
The image based on the content is an image in which the display state of the content is changed or a part of the entire image of the content. The method of claim 1,
And when an item of the content is selected, the image based on the content is an image corresponding to the selected item. The method of claim 1,
And the information includes payment information or user identity information. The method of claim 1,
The method further comprises: connecting to the server;
And transmitting the signal via the server. Displaying content including a plurality of items on a display unit;
Selecting at least one item of the plurality of items;
Changing a display state of a screen displayed on the display unit based on the selected item;
Receiving an input signal related to the selected item from a mobile terminal; And
And displaying a feedback image corresponding to the input on the display unit. 9. The method of claim 8,
And receiving a content playback command from the portable terminal. 9. The method of claim 8,
And a selection input for at least one of the plurality of items is received from a remote control device or the portable terminal. 9. The method of claim 8,
The changing of the display state may include changing at least one of a size, a color, and a transparency of the selected item or giving a highlight effect. 9. The method of claim 8,
The changing of the display state may further include displaying an image corresponding to the selected item. 9. The method of claim 8,
The changing of the display state may include switching a screen to an image corresponding to the selected item. 9. The method of claim 8,
The feedback image includes a result information according to the input. 9. The method of claim 8,
The method further comprises: connecting to the server;
And receiving the signal via the server. Receiving a command for sharing content displayed on the image display device;
Displaying an image based on the content; And
If the rotation is detected, varying the display state of the image;
The changing of the display state may further include displaying information related to the content when the rotation of the screen of the mobile terminal is rotated such that the length in the vertical direction is greater than the length in the horizontal direction. . 17. The method of claim 16,
And a command for sharing the content is a gesture that pulls at least one surface of the portable terminal toward the user. 17. The method of claim 16,
The image based on the content is an image in which the display state of the content is changed or a part of the entire image of the content. 17. The method of claim 16,
The changing of the display state may include reducing the size of an area where the content is displayed. The method of claim 16,
The changing of the display state may include displaying the content on a full screen when the rotation is such that the screen of the mobile terminal is rotated such that the length in the vertical direction is smaller than the length in the horizontal direction.

Images