KR101891614B1 - Method for operating a Mobile terminal and an Image Display Device - Google Patents

Abstract

A method of operating a portable terminal according to an exemplary embodiment of the present invention includes receiving a command for sharing contents displayed on a video display device, displaying an image based on the content, displaying an input window, And transmitting a signal based on the input information.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and an image display device,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a portable terminal and an operation method of an image display apparatus that can share contents and information. And more particularly, to a portable terminal and a video display device that can be controlled by a portable terminal, which can improve user convenience by displaying various information in association with the portable terminal and the video display device.

In recent years, network technologies have been developed in which various electronic devices are connected to each other to enjoy convenient, safe and economical living services at home and outside. Such a network may be configured by connecting electronic devices such as a PC, a TV, a refrigerator, and a portable terminal of a plurality of members to each other to share or transmit various data.

On the other hand, the portable terminal is a portable device having one or more functions of being capable of carrying and inputting information, capable of performing voice and video communication, and capable of storing data while being portable. As the functions of the portable terminal have diversified, they have been equipped with complicated functions such as photographing and photographing of movies, playing music files or video files, receiving games, broadcasting, wireless Internet, etc., and a comprehensive multimedia device .

Meanwhile, the portable terminal provides a variety of convenient user interface environments such as a touch input, a menu screen, and the like, in which characters can be input by touch input through a screen.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a method of operating a portable terminal and a video display device that can improve the usability of a user.

It is another object of the present invention to provide a user interface that can be applied to a portable terminal and an image display device that displays various information to enable a user to conveniently use the image display device.

According to another aspect of the present invention, there is provided a method of operating a portable terminal including receiving a command for sharing contents displayed on a video display device, displaying an image based on the content, And transmitting a signal based on the information input in the input window.

According to another aspect of the present invention, there is provided a method of operating an image display apparatus including displaying a content including a plurality of items on a display unit, selecting at least one item among the plurality of items, A step of varying a display state of the screen displayed on the display unit based on the selected item, a step of receiving an input signal related to the selected item from the portable terminal, and a step of displaying a feedback image corresponding to the input on the display unit .

According to another aspect of the present invention, there is provided a method of operating a portable terminal, including receiving a command for sharing content displayed on a video display device, displaying an image based on the content, And the display state changing step further includes displaying information related to the content when the rotation is such that the length of the screen of the portable terminal is longer than the length of the horizontal direction .

According to the embodiment of the present invention, various contents and information are shared by the portable terminal and the video display device, so that the user can manage and utilize contents and information more conveniently and variously.

On the other hand, various user interfaces can be provided in the portable terminal and the image display device, and the user's convenience of use can be increased.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
2 is an internal block diagram of the control unit of FIG.
3 is a diagram showing the operation of the remote control apparatus of FIG.
FIG. 4A is a perspective view of a remote control device according to an embodiment of the present invention, and FIG. 4B is an internal block diagram of the remote control device.
5 is an internal block diagram of a portable terminal according to an embodiment of the present invention.
6 is a diagram illustrating a front view of a portable terminal according to an exemplary embodiment of the present invention.
FIGS. 7 to 18 are views for explaining various examples of the operation method of the portable terminal and the image display device according to the embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

Meanwhile, the video display device described in this specification is an intelligent video display device to which a computer-supporting function is added to a broadcast receiving function, and is equipped with an Internet function while being faithful to a broadcast receiving function, It can be equipped with a more convenient interface such as a space remote controller. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

That is, since various applications can be freely added or deleted on the general-purpose OS kernel, the video display device described in the present invention can perform various user-friendly functions. For example, it may be a smart TV.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

1, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user input interface unit 150, A control unit 170, a display unit 180, an audio output unit 185, and a power supply unit 190. The broadcast receiving unit 105 may include a tuner 110, a demodulating unit 120, and a network interface unit 130. The tuner 110 and the demodulator 120 may be selectively provided with the network interface unit 130.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 110 can be directly input to the controller 170.

Also, the tuner 110 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner 110 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs an 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulation unit 120 may perform channel decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulating unit 120 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs the video to the display unit 180 and audio to the audio output unit 185.

The external device interface unit 135 can connect the external device and the video display device 100. [ To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface unit 135 transmits external video, audio, or data signals to the controller 170 of the video display device 100 through a connected external device. Also, the control unit 170 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The image display apparatus 100 is capable of performing communication such as Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, DLNA (Digital Living Network Alliance) Depending on the standard, it can be networked with other electronic devices.

Also, the external device interface unit 135 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

Meanwhile, the external device interface unit 135 may receive the application or application list in the adjacent external device, and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The network interface unit 130 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. The network interface unit 130 may include an Ethernet terminal or the like for connection to a wired network and may be a WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless) broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

On the other hand, the network interface unit 130 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 130 can select and receive a desired application among applications open to the public via a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

The storage unit 140 may also function to temporarily store video, audio, or data signals input from the external device interface unit 135 or the network interface unit 130. In addition, the storage unit 140 may store information on a predetermined broadcast channel through the channel memory function.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 130. [

The storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The video display apparatus 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

1 shows an embodiment in which the storage unit 140 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be configured to turn on / off the power, select the channel, and display the screen from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared Or a control signal from the control unit 170 to the remote control device 200. The remote control device 200 may be configured to receive the control signal from the control unit 170. [

For example, the user input interface unit 150 may transmit a user input signal or a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170 have.

For example, the user input interface unit 150 may transmit a user input signal or a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 170, (Not shown) can be transmitted. Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 135 to generate a signal for video or audio output Can be generated and output.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 according to a user command or an internal program input through the user input interface unit 150. In particular, the user can access a network and download a list of applications or applications desired by the user to the video display device 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The control unit 170 allows the display unit 180 or the audio output unit 185 to output the video or audio signal processed by the user through the channel information or the like selected by the user.

For example, the control unit 170 may control the operation of the external device through the external device interface unit 135, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 150 So that the video signal or the audio signal of the audio signal output through the display unit 180 or the audio output unit 185 can be outputted.

Meanwhile, the control unit 170 may control the display unit 180 to display an image. For example, the broadcast image input through the tuner 110, the external input image input through the external device interface unit 135, the image input through the network interface unit, or the image stored in the storage unit 140 may be displayed on the display unit 180). ≪ / RTI > At this time, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

On the other hand, when entering the application viewing item, the control unit 170 can control to display a list of applications or applications that can be downloaded from the video display device 100 or from an external network.

The control unit 170 can control to install and drive an application downloaded from an external network, in addition to various user interfaces. Further, it is possible to control so that an image related to the executed application is displayed on the display unit 180 by the user's selection.

The control unit 170 controls the display unit 180 to display the collected related information when a search word related to the displayed image is input. If there is a zoom in or zoom out input from the remote control device 200, And displays the related information on the display unit 180 by zooming in or out. The zoom-in or zoom-out input may be performed by the remote control device 200 being moved to approach the display portion 180 or to move away from the display portion 180. [

On the other hand, when the displayed image is a moving image, the control unit 170 can control to stop the moving image when the search word is input. At this time, it is also possible to display an object representing the reproduction of the image on the display unit 180.

On the other hand, the control unit 170 can control to display a keyboard on the display unit 180 in order to input a search word. When a character in the keyboard displayed by the user's selection is selected, can do.

On the other hand, when receiving the character selected from the button in the video display device 200, the control unit 170 can control that the character is input based on the received signal.

In addition, the control unit 170 can control that a search word corresponding to an image in the selected area is input when a partial area in the displayed image is selected by the user. For example, an image in the selected area may be searched in an image display device or on a network, and an image similar to the image may be searched to identify the content, and a search word may be derived. Alternatively, it is possible to utilize meta data added to an image in the selected region to derive a search word using related information included in the metadata.

In order to display the search result, the controller 170 displays a plurality of items in which related information is sorted in one area of the display unit 180, and displays related information on the selected item among the displayed items on the display unit 180 On the other area of the display screen. These items may be a music item, a video item, a web item, a map item, an application item, and these items may be added or deleted according to the setting of the user, and the order of the items displayed according to the priority order may vary It is possible.

For example, when an application item of the items is selected, it can be controlled to display downloadable application information from the relevant information within the image display apparatus 100 or from an external network.

The control unit 170 can control to install and drive an application downloaded from an external network, in addition to various user interfaces. It is possible to control the display unit 180 to display an image related to the executed application.

On the other hand, the control unit 170 can control to display an input window for inputting a search word. The input window may be displayed in an area different from the image displayed on the display unit 180, or overlaid on the image Can be displayed.

On the other hand, when there is the exit of the related information display or the exit input of the zoom in or zoom out display, the control unit 170 can control to display the previously displayed image on the display unit 180. [ At this time, it is also possible to display the reproduction object indicating the reproduction of the image on the display unit 180. [

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 135 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be directly or encoded and input to the controller 170. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display unit 180 using the input thumbnail images. On the other hand, the thumbnail images in this thumbnail list can be updated in sequence or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170 or a video signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively Thereby generating a driving signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

Meanwhile, the display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the control unit 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

On the other hand, a photographing unit (not shown) for photographing a user can be further provided. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. The image information photographed by the photographing unit (not shown) is input to the control unit 170.

In order to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further provided in the image display apparatus 100 have. A signal sensed by a sensing unit (not shown) may be transmitted to the controller 170 through the user input interface unit 150.

The control unit 170 may sense the gesture of the user by combining the images photographed by the photographing unit (not shown) or the signals sensed by the sensing unit (not shown).

The power supply unit 190 supplies power to the entire image display apparatus 100. Particularly, it is possible to supply power to a control unit 170 that can be implemented in the form of a system on chip (SOC), a display unit 180 for displaying an image, and an audio output unit 185 for audio output .

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. Meanwhile, for example, when the display unit 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) that can perform a PWM operation for variable luminance or dimming driving is further provided It is possible.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control device 200 can use RF (Radio Frequency) communication, infrared (IR) communication, Bluetooth, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote control apparatus 200 can receive the video, audio or data signal output from the user input interface unit 150 and display it on the remote control apparatus 200 or output sound or vibration.

The video display apparatus 100 described above can be applied to a digital broadcasting of ATSC system (8-VSB system), digital broadcasting of DVB-T system (COFDM system), digital broadcasting of ISDB-T system (BST-OFDM system) And a digital broadcasting receiver capable of receiving at least one of the digital broadcasting signals.

The video display device described in the present specification is a video display device excluding the display unit 180 and the audio output unit 185 shown in FIG. 1 and includes a display unit 180 and an audio output Or a wireless type for transmitting / receiving data to /

Meanwhile, the block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

The video display apparatus 100 does not include the tuner 110 and the demodulator 120 shown in FIG. 1 and receives video content through the network interface unit 130 or the external device interface unit 135 And reproduce it.

On the other hand, the video display device 100 is an example of a video signal processing device that performs signal processing of a video image or an input video image stored in the device. Other examples of the video signal processing apparatus include a set-top box, a DVD player, a Blu-ray player, a game machine, a computer, and the like, except for the display unit 180 and the audio output unit 185 shown in FIG. 1 .

2 is an internal block diagram of the control unit of FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355 ), And a formatter 360. A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 135.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display unit 180.

The video decoder 325 can include a decoder of various standards.

For example, if the demultiplexed video signal is an MPEG-2 standard encoded video signal, it can be decoded by an MPEG-2 decoder.

Also, for example, if the demultiplexed video signal is an encoded video signal of the H.264 standard according to the DMB (Digital Multimedia Broadcasting) scheme or DVB-H, it can be decoded by the H.264 decoder.

Meanwhile, the video signal decoded by the video processor 320 is input to the mixer 350.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a user input signal or a control signal, a signal for displaying various information in graphic or text on the screen of the display unit 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon.

For example, the OSD generating unit 340 may generate a signal for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 220. The mixed signal is provided to formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

A frame rate converter (FRC) 355 can convert a frame rate of an input image. For example, a frame rate of 60 Hz is converted to 120 Hz or 240 Hz. When converting the frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame between the first frame and the second frame, or insert the third frame predicted from the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or insert three predicted frames. On the other hand, it is also possible to maintain the input frame rate without performing another conversion.

The formatter 360 receives the output signal of the frame rate conversion unit 355 and changes the format of the signal to be suitable for the display unit 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

When a demultiplexed speech signal is a coded speech signal, the speech processing unit (not shown) in the control unit 170 can decode the demultiplexed speech signal. For example, the demultiplexed speech signal may be decoded by an MPEG-2 decoder, an MPEG 4 decoder, an AAC decoder, or an AC-3 decoder.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme and may include DVB-SI information in the DVB scheme . The ATSC-PSIP information or DVB-SI information may be information included in the above-described stream, i.e., the header (4 bytes) of the MPEG-2 TS.

Meanwhile, the block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

3 is a diagram showing the operation of the remote control apparatus of FIG.

Referring to the drawings, the remote control apparatus 200 can transmit and receive signals in accordance with the RF communication standard or the IR communication standard with the image display apparatus 100.

3 (a) illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. As shown in Fig.

The user can move or rotate the remote control device 200 up, down, left and right (Fig. 3 (b)), front and rear (Fig. 3 (c) The pointer 205 displayed on the video display device 100 corresponds to the movement of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

3B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the image display device 100 moves to the left correspondingly. Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device 100. [ The image display apparatus 100 can calculate the coordinates of the pointer 205 from the information on the motion of the remote control device 200. [ The image display apparatus 100 can display the pointer 205 so as to correspond to the calculated coordinates.

3C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is pressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed. On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control device 200 moves away from or approaches the display unit 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to a point on a horizontal axis or a vertical axis on the display unit 180 or may be displayed corresponding to a plurality of points such as a line or a surface Do.

4A is a diagram showing an example of a remote control device and a spatial remote controller 201 according to an embodiment of the present invention.

Referring to the drawings, a spatial remote controller 201 according to an embodiment of the present invention may include various input keys, input buttons, and the like.

For example, the spatial remote controller 201 may include an Okay key 291, a menu key 292, a four-way key 293, a channel adjustment key 294, and a volume adjustment key 296 have.

For example, the Okay key 291 may be used to select a menu or an item, the menu key 292 may be used to display a predetermined menu, and the four directional keys 293 may be a pointer or an indicator, The channel adjustment key 294 can be used for channel up and down adjustment, and the volume adjustment key 296 can be used for volume up and down adjustment.

In addition, the spatial remote controller 201 may further include a back key 297 and a home key 298. For example, a back key 297 may be used to move to a previous screen, and a home key 298 may be used to move to a home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. For this, the confirmation key 291 can be implemented as a wheel key. That is, when the OK key 291 is pressed, it is used as a menu or item selection. When the OK key 291 is scrolled up and down, a display screen scrolling or a list page switching can be performed.

Specifically, when an image larger than the size of the display is displayed on the display unit 180 and the OK key 291 is scrolled to search for the corresponding image, the image area that is not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, the previous page or the next page of the current page can be displayed by scrolling the OK key 291. [

This scroll function may be provided with a separate key other than the confirmation key 291. [

On the other hand, the four directional keys 293 can be arranged in four directions in the circular type, as shown in the figure, up, down, left, and right keys. Touch input to the four directional keys 293 may also be possible. For example, if there is a touch operation from the up key to the down key in the direction key 293, the set function may be inputted or performed according to the corresponding touch input.

4B is an internal block diagram of the remote control device of FIG.

The remote control device 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, And may include a control unit 280.

The wireless communication unit 225 transmits and receives signals to and from the video display device 100. In this embodiment, the remote control device 200 may include an RF module 221 that can transmit and receive signals to and from the image display device 100 according to the RF communication standard. Also, the remote control device 200 may include an IR module 223 capable of transmitting and receiving signals with the image display device 100 according to the IR communication standard.

In this embodiment, the remote control device 200 transmits a signal containing information on the motion of the remote control device 200 to the image display device 100 through the RF module 221. Also, the remote control device 200 can receive the signal transmitted by the video display device 100 through the RF module 221. [ Also, the remote control device 200 can transmit a command regarding power on / off, channel change, volume change, and the like to the image display device 100 through the IR module 223 as necessary.

The user input unit 235 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the video display device 100 by operating the user input unit 235. [ When the user input unit 235 has a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 235 has a touch pad, the user can touch the touch pad and input a command related to the image display device 100 to the remote control device 200. [ In addition, the user input unit 235 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 can sense information on the motion of the remote control device 200. [ For example, the gyro sensor 241 can sense information on the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 243 can sense information on the moving speed of the remote control device 200 and the like. Meanwhile, a distance measuring sensor may be additionally provided, so that the distance to the display unit 180 can be sensed.

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the image display device 100. [ The user can recognize whether the user input unit 235 is operated or whether the video display device 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when a user input unit 235 is operated or a signal is transmitted and received between the image display device 100 and the image display device 100 through the wireless communication unit 225, 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce the power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives signals through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band Send and receive. The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving a signal with the image display device 100 paired with the remote control device 200 in the storage unit 270 Can be referenced.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 and a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240, (100).

FIG. 5 is an internal block diagram of a portable terminal according to an embodiment of the present invention, and FIG. 6 illustrates a front view of a portable terminal according to an exemplary embodiment of the present invention.

5, the portable terminal 500 includes a user interface unit 510, an audio / video (A / V) input unit 520, a network interface unit 530, an external device interface unit 535, A storage unit 550, a control unit 560, a display unit 570, an audio output unit 580, and a power supply unit 590. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

Meanwhile, the portable terminal described in this specification may be, for example, a smartphone as shown in FIG. 6 (a) and a tablet PC as shown in FIG. 6 (b).

In addition, the portable terminal described in the present specification may be applied to a portable terminal such as a tablet computer, a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) , Navigation, and the like.

 Meanwhile, the portable terminal described in the present specification can be connected to the Internet and a computer through the support of a wired or wireless Internet function, and can also perform functions such as e-mail, web browsing, banking, or a game. Also, voice and video communication functions can be performed, and the communication mode can be performed using an Internet network, a mobile communication network, or the like according to VoIP (Voice over Internet Protocol).

The user input unit 510 generates key input data that the user inputs for controlling the operation of the portable terminal. The user input unit 510 may include a key pad, a switch, and a touch screen (static / static) that can receive commands or information by a push or touch operation of the user. The user input unit 510 may be a jog wheel for rotating a key, a jog type or a joystick, or a finger mouse.

The A / V (Audio / Video) input unit 520 is for inputting an audio signal or a video signal, and may include a camera, a microphone, and the like. The camera processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 570.

The image frame processed by the camera may be stored in the storage unit 550 or may be transmitted to the outside through the network interface unit 530 or the external device interface unit 535. Two or more cameras may be provided according to the configuration of the terminal.

The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data.

The network interface unit 530 provides an interface for connecting the portable terminal 500 to a wired / wireless network including the Internet network.

The network interface unit 530 can transmit or receive data to another user or another electronic device via the network to which it is connected or another network linked to the connected network. Particularly, it is possible to transmit a part of content data stored in the portable terminal 500 to another user registered in the portable terminal 500 or a selected user or selected one of the other electronic devices.

On the other hand, the network interface unit 530 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 530 can select and receive a desired application among the applications open to the public via the network.

The network interface unit 530 may be connected to the mobile communication network and include a mobile communication unit for voice and video communication. The mobile communication unit transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

In addition, the portable terminal 500 may receive signals related to broadcasting through a wired / wireless Internet network, and may further include a separate broadcasting receiver (not shown) for receiving broadcasting.

The broadcast receiver may receive at least one of a broadcast signal and broadcast related information from outside, and may include a tuner, a demodulator, a demultiplexer, a decoder, and the like for signal reception and signal processing.

The external device interface unit 535 can connect the external device and the portable terminal 500. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 535 can be connected to an external device such as a TV, a digital versatile disk (DVD), a Blu ray, a game device, a camera, a camcorder, a computer have. The external device interface unit 535 transmits external video, audio, or data signals to the control unit 560 of the portable terminal 500 through the connected external device. Also, the control unit 560 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 535 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The portable terminal 500 may be a wireless communication device such as an NFC (Near Field Communication), a Bluetooth, a Radio Frequency Identification (RFID), an IrDA, an Ultra Wideband (UWB), a ZigBee, And DLNA (Digital Living Network Alliance).

In addition, the external device interface unit 535 serves as an interface with all the external devices connected to the mobile terminal 500, in addition to the above-described external device. Examples of the external device connected to the portable terminal 500 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The external device interface unit 535 receives data from the external device or receives power from the external device, and transmits the data to each component in the portable terminal 500. The data in the portable terminal 500 is transmitted to the external device .

Meanwhile, the external device interface unit 535 may receive the application or application list in the adjacent external device, and may transmit the received application or application list to the control unit 560 or the storage unit 550.

The control unit 560 transmits a control signal by a user's command or program to another electronic device connected through the network interface unit 530 or the external device interface unit 535 or transmits the control signal received from the permitted electronic device Based commands. For example, it is possible to control a video display device, perform a reservation operation using a PC connected to a home network, check contents of a smart refrigerator, and receive various signals such as messages or commands from a smartphone of a family member .

The sensor unit 540 senses the current state of the portable terminal 500, such as the position of the portable terminal 500, whether or not the user touches the portable terminal 500, and generates a sensing signal for controlling the operation of the portable terminal 500.

The sensor unit 540 may include a sensing sensor, a pressure sensor, and a motion sensor. The detection sensor can detect an object approaching the portable terminal 500 or the presence or absence of an object in the vicinity of the portable terminal 500 without mechanical contact. The detection sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or the rate of change of the capacitance. More than two detection sensors may be provided depending on the configuration.

The pressure sensor can detect whether the pressure is applied to the portable terminal 500, the magnitude of the pressure, and the like. The pressure sensor may be installed in a portion of the portable terminal 500 where pressure detection is required depending on the use environment. If the pressure sensor is installed on the display unit 570, the touch input through the display unit 570 and the pressure touch input to which a greater pressure than the touch input is applied are identified according to the signal output from the pressure sensor . In addition, the magnitude of the pressure applied to the display unit 570 at the time of pressure-touch input can be determined according to the signal output from the pressure sensor.

The motion sensor senses the position or movement of the portable terminal 500 using an acceleration sensor, a gyro sensor, or the like. The acceleration sensor, which can be used for the motion sensor, is a device that converts an acceleration change in one direction into an electric signal. The gyro sensor can sense the angular velocity and direction of the reference direction, Can be sensed based on the x, y, and z axes. The acceleration sensor can sense information on the moving speed and the like of the portable terminal 500. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The storage unit 550 may store a program, a platform, and an application for each signal processing and control in the controller 560, and may store signal processed video, audio, or data signals.

Meanwhile, the portable terminal 500 may reproduce and provide a content file (a moving picture file, a still picture file, a music file, a document file, an application file, etc.) stored in the storage unit 550 to a user.

The storage unit 550 may also function to temporarily store video, audio, or data signals input from the external device interface unit 535 or the network interface unit 530.

The storage unit 550 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory Etc.), RAM, ROM (EEPROM, etc.), and the like.

Meanwhile, FIG. 5 illustrates an embodiment in which the storage unit 550 is provided separately from the control unit 560, but the scope of the present invention is not limited thereto. The storage unit 550 may be included in the control unit 560.

The control unit 560 can control the overall operation in the portable terminal 500. [ For example, the control unit 560 may control the portable terminal 500 through a user command or an internal program input through the user interface unit 510. [ In particular, the mobile terminal 500 can access a network and download a list of applications or applications desired by the user to the portable terminal 500.

The control unit 560 allows the video or audio to be output through the display unit 570 or the audio output unit 580 based on the received signal.

The control unit 560 may control the operation of the external device through the external device interface unit 535 according to the external device video playback command received through the user interface unit 510. For example, , So that a video signal or a voice signal can be output through the display unit 570 or the audio output unit 580.

On the other hand, the control unit 560 can control the display unit 570 to display the image of the communication partner and the image of the user in the video communication mode according to the setting of the user, and can display the voice based on the voice signal of the communication partner So that the audio output unit 580 can output it.

Also, the control unit 560 can control to reproduce the content. The contents at this time may be contents stored in the portable terminal 500, received broadcast contents, or external input contents input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Also, the control unit 560 can determine whether the touch input corresponds to a character input such as an alphabet, a number, or a symbol, based on the pattern of the touch input signal. The control unit 560 can confirm the character corresponding to the trajectory of the touch input based on the database. The database includes Korean, English, Chinese, Japanese, numerals, symbols, and the like, and may be stored in the control unit 560 or the storage unit 550.

The control unit 560 can control, in addition to various user interfaces, to install and operate an application downloaded from the external network. In addition, by the user's selection, it is possible to control the display unit 570 to display an image related to the executed application.

Any one of the portable terminals 500 according to the embodiments of the present invention may include OS-based software to perform various operations as described above. Meanwhile, the platform may be provided in a form of a program in a control unit or a separate processor, or may be stored in a storage unit.

Any one of the mobile terminals according to the embodiments of the present invention may include an OS kernel, a driver on an OS kernel, a middleware, a framework, an application layer, . ≪ / RTI >

The OS kernel can be implemented in various operating system (OS) based kernels such as Unix-based (Linux) and Windows-based. In addition, the OS kernel is an open OS kernel, and it can be general-purpose which can be used in other electronic devices and the like.

The display unit 570 converts the video signal, the data signal processed by the control unit 560 or the video signal and the data signal received from the network interface unit 530, the external device interface unit 535 into R, B signal to generate a driving signal.

The display unit 570 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, or the like.

Meanwhile, the display unit 570 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 580 outputs audio data received or stored in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The audio output unit 580 outputs sound signals related to a function performed in the portable terminal 500, for example, a call signal reception sound, an effect sound, and the like. The audio output unit 180 may include a speaker, a buzzer, and the like.

Meanwhile, the power supply unit 590 supplies the corresponding power supply throughout the portable terminal 500.

5 may include a wired / wireless communication system, a satellite-based communication system, and may transmit data through a frame or a packet. Lt; / RTI > communication system.

FIGS. 7 to 14 are views for explaining various examples of the operation method of the portable terminal and the image display apparatus according to the embodiment of the present invention.

7 is a flowchart illustrating an operation method of a mobile terminal according to an exemplary embodiment of the present invention.

First, the portable terminal according to an embodiment of the present invention receives a command for sharing contents displayed on a video display device (S710)

Here, the command for sharing contents can be input in various ways.

For example, the sharing of the contents may be performed by selecting a shared menu displayed on the display unit 570 of the portable terminal 500, or by snathing to pull at least one side of the portable terminal 500 to the user, It can be a gesture.

The snathing operation is advantageous in that a user can input a content sharing command without moving his gaze while using the content.

Referring to FIG. 11, it can be seen that a side 1120 of the portable terminal after the snapping gesture has been performed is closer to the user than the side 1120 of the portable terminal before the snapping gesture.

Meanwhile, the method of operating a portable terminal according to an exemplary embodiment of the present invention may further include transmitting a content playback command to the video display device. That is, the content can be displayed on the video display device to use the content on the large screen of the video display device, and then the portable terminal can be used if necessary.

Then, the portable terminal 500 receiving the command for sharing contents displays the image based on the content (S720)

In this case, the image based on the content may be an image changed in the display state of the content, or may be a part of the entire image of the content.

Although not shown in FIG. 7, the apparatus may further include a step of performing a network connection with an image display apparatus, and transmitting and receiving data for content sharing. The data for content sharing may be the content data itself, or may be the title of the content, the URL in which the content is stored, the reproduction timing information, and the authentication information.

Meanwhile, the contents displayed on the image display device may include a plurality of items, and the image based on the content may be an image related to any one of the plurality of items.

In particular, if any of the contents is selected, the image based on the content may be an image corresponding to the selected item.

For example, if the content is an application store, when one of the applications is selected, an image related to the selected application can be displayed.

Hereinafter, a process of purchasing an application will be described as an example, but the present invention is not limited thereto.

Thereafter, an input window corresponding to the displayed image is displayed (S730)

That is, in the case of the previous application store example, an application purchase window or a payment information input window or an identity information input window may be displayed, and the information may include payment information or user identification information.

When the input of the user is completed, a signal based on the information input in the input window is transmitted to the image display device (S740)

The mobile terminal is a personalized electronic device, which is superior in terms of security and privacy protection than a common electronic device. Accordingly, since various payment methods and security methods using mobile terminals are being studied, they can be utilized for purchasing. In addition, since the portable terminal and the video display device are characterized in that various information is displayed using two devices, the portable terminal can be used for inputting information for purchase

FIG. 12 illustrates a process of purchasing a TV application using a portable terminal.

Referring to FIG. 12, the purchase page 1200 displayed on the video display device through the above-described snatch operation or the like is loaded into the portable terminal. When the user selects the purchase item 1210, the portable terminal displays an input window 1221 for inputting information necessary for purchase on the screen.

In this case, a tool can be displayed to help input such as the screen keyboard 1222. In general, the information for purchasing is often composed of a combination of alphanumeric. The image display device is relatively difficult to input alphanumeric information as compared with a PC or a mobile terminal, It is easy to input information.

Then, the portable terminal can display information 1230 corresponding to the user's input, such as the completion of payment.

Meanwhile, a method of operating a portable terminal according to an embodiment of the present invention may further include connecting to a server, and the signal and various data may be transmitted through the server. That is, it can be connected to a direct image display device via a network and transmit and receive signals and data, as well as through a server.

8 is a flowchart of an operation method of an image display apparatus according to an embodiment of the present invention.

The video display device displays a content including a plurality of items on the display unit 180 (S810)

On the other hand, the playback command of the displayed content can be input through a local key provided on the remote control device, the video display device, a user's touch or a gesture.

Or receiving a content reproduction command from the portable terminal, and may display the corresponding content.

For example, when the user selects the TV application store access menu among the menu icons of the portable terminal, the video display apparatus can access the TV application store.

After accessing the TV application store, the application store can be displayed as shown in FIG. 10 (a).

Then, at least one item 1011 of the plurality of items 1010 is selected by one of various means such as a remote control device, a portable terminal, a user's touch or input through a gesture (S820)

That is, a selection input for at least one item among the plurality of items can be input from various means such as a remote control device or the portable terminal.

If there is a selection input, the display state of the screen displayed on the display unit 180 is varied based on the selected item (S830)

The display state variable step S830 may change at least one of the size, color, and transparency of the selected item. Alternatively, as shown in FIG. 10, a highlight effect can be given to the selected item.

On the other hand, the display state varying step S830 may further display an image corresponding to the selected item. For example, the image corresponding to the selected item can be displayed in the form of a pop-up window.

Alternatively, the display state variable step S830 can switch the screen to the video corresponding to the selected item in the entire screen. For example, as shown in FIG. 10B, it can be switched to the purchase screen 1020 of the selected item.

Thereafter, the input signal related to the selected item is received from the portable terminal (S840). Here, the input signal may include at least one of an input for controlling the selected item, payment information, or identity information of the user.

Thereafter, a feedback image corresponding to the input is displayed on the display unit 180 (S850)

Here, the feedback image may include result information 1310 according to the input. The result information 1310 may include information for confirming the input contents of the user, a process corresponding to the input of the user, and information indicating completion of the process.

Meanwhile, a method of operating an image display apparatus according to an exemplary embodiment of the present invention may further include a step of connecting to a server, and the signal and various data may be transmitted through the server. That is, it can be directly connected to the portable terminal through a network, and can transmit and receive signals and data as well as through the server.

Meanwhile, according to an embodiment of the present invention, when the mobile terminal and the video display device use the application store contents, they can operate in the order of FIGS. 10, 11, 12, and 13.

Meanwhile, FIG. 14 shows an example of using calendar contents through a portable terminal and a video display device.

14, the image display apparatus 100 displays a lot of information, for example, a calendar 1410 for one month, and the portable terminal 500 displays a selected item 1410, for example, 7 Can be used as an input means for confirming or updating the detailed schedule 1420 of the 7th month.

That is, according to the present invention, information displayed on a portable terminal and a video display device in association with each other can be displayed on a more suitable device, thereby enhancing the user's convenience.

FIG. 9 is a signal flow diagram between the portable terminal 500 and the image display apparatus 100, which has been described with reference to FIGS. 7 and 8, and will be briefly described.

The portable terminal 500 may transmit a control command, for example, a content reproduction command, an Internet access command, etc. to the video display device 100. In operation S910,

The video display apparatus 100 displays predetermined content and when a user who has used the content through the large screen of the video display apparatus 100 inputs a command for content sharing, the portable terminal 500 displays the content on the video display apparatus 100 (S920)

The portable terminal 500 receives information and data for content sharing from the video display device 100 (S930), and displays an input window when a video based on the content and input are required.

When the input of the user is completed, the portable terminal 500 transmits it to the image display apparatus 100 (S940)

15 to 18 are views for explaining various examples of the operation method of the portable terminal and the image display apparatus according to the embodiment of the present invention.

Referring to the drawings, a command for sharing the content 1610 displayed on the video display device is received (S1510). Here, the command for sharing the content may be a gesture for pulling at least one side of the portable terminal to the user side .

The mobile terminal displays the image 1710 based on the content (S1520). Here, the image based on the content may be a video image with a changed display state such as the size and resolution of the content, .

If the rotation of the portable terminal is detected (S1530), the display state of the image is changed (S1540)

If the rotation of the portable terminal rotates so that the length of the screen in the vertical direction is greater than the length in the horizontal direction, information 1730 related to the content may be further displayed as in the example of FIG.

In this case, the information 1730 related to the content may be displayed in the form of a pop-up or may be displayed after reducing the size of the area in which the content is displayed.

That is, the reduced image 1720 of the content may be displayed in a predetermined area, and the information 1730 related to the content may be displayed in the remaining area.

Meanwhile, the information 1730 related to the content may be real-time search, shopping, recommendation items, and the like for the currently used content.

Conversely, when the rotation is such that the length of the screen of the portable terminal is smaller than the length of the horizontal direction, the display state varying step S1540 may display the content on the entire screen.

18, even when a plurality of contents such as a live broadcast image 1810 and a social network application or widget 1820 are displayed on the video display device, the mobile terminal can have a different screen configuration have.

For example, when the portable terminal is rotated longitudinally, the display state of the content corresponding to the live broadcast image 1830 at the upper end and the social network application or widget 1840 at the lower end can be changed and displayed.

Meanwhile, when the rotation of the portable terminal is sensed, it is also possible to display network-connected electronic devices and available content items.

According to the embodiment of the present invention, various contents and information are shared by the portable terminal and the video display device, so that the user can manage and utilize contents and information more conveniently and variously.

On the other hand, various user interfaces can be provided in the portable terminal and the image display device, and the user's convenience of use can be increased.

The method of operating the portable terminal and the image display device according to the present invention is not limited to the configuration and method of the embodiments described above, but the embodiments may be modified in various ways, Or some of them may be selectively combined.

Meanwhile, the operation method of the portable terminal and the image display apparatus of the present invention can be implemented as a code readable by a processor in a processor-readable recording medium provided in a portable terminal and an image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Receiving an instruction for sharing contents displayed on a video display device;
Displaying a purchase page screen based on the content;
Displaying an input window for inputting information necessary for purchase when a purchase item included in the purchase page screen is selected; And
And transmitting a signal based on the information input to the input window to the image display apparatus,
Wherein the command for sharing the contents is a gesture for pulling at least one side of the portable terminal to the user side. The method according to claim 1,
And transmitting the content playback command to the video display device. delete The method according to claim 1,
Wherein the purchasing page screen based on the content is an image obtained by changing the display state of the content or a part of the entire image of the content. delete delete The method according to claim 1,
Further comprising: connecting to the server,
Wherein the transmission of the signal is via the server.



delete delete delete delete delete delete delete delete delete delete delete delete delete

Images