KR101882712B1 - Method for controlling mobile terminal by using tv and apparatus thereof - Google Patents

Abstract

The present invention relates to a method of controlling a mobile communication terminal using a TV, the method comprising: receiving data including an image from the mobile communication terminal; Dividing a display portion of the TV into a predetermined ratio; And displaying the TV content in one area of the divided display part and displaying the image in another area. [0002] The present invention relates to a control method for a mobile communication terminal using a TV.
In addition, the present invention relates to a TV for controlling a mobile communication terminal, comprising: a wireless communication unit for receiving data including an image from the mobile communication terminal; A display unit for displaying the TV content in one area divided at an arbitrary ratio and displaying the image in another area; And a control unit for dividing the display unit at the arbitrary ratio, displaying the TV contents in one divided area, and controlling the display unit to display the image in another area.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a control method for a mobile communication terminal using a TV,

The present invention relates to a control method of a mobile communication terminal using a TV and an apparatus therefor.

2. Description of the Related Art Recently, various convenience functions have been added to mobile communication terminals such as cellular phones, personal digital assistants (PDAs), and portable multimedia players (PMPs) An OSP (On Screen Phone) function for connecting a TV or a computer and outputting a screen of the mobile communication terminal to a TV or a computer is becoming common.

In the case of the OSP function using the computer, it takes a long time to boot the computer, and the size is small, which makes it inconvenient to use. Therefore, OSP technology using digital TV is being actively performed.

In general, since the TV content broadcasted has a 16: 9 aspect ratio, the TV screen has a 16: 9 aspect ratio in order to output the TV content without distortion.

When a screen of a mobile communication terminal is output to a digital TV using such a 16: 9 aspect ratio, there is a problem that a margin for outputting a terminal screen is not separately provided, thereby covering the TV content screen due to the terminal screen.

The present invention provides a method and apparatus for outputting TV content in a 16: 9 aspect ratio area using a TV having a 21: 9 aspect ratio and outputting a terminal screen in a 5: 9 aspect ratio area .

The present invention also provides a method and apparatus for controlling a terminal using a terminal screen output to a TV and utilizing various functions of the terminal on a TV.

A method of controlling a mobile communication terminal using a TV, the method comprising: receiving data including an image from the mobile communication terminal; controlling a display unit of the TV to a predetermined ratio And displaying the TV content in one area of the divided display unit 140 and displaying the image in another area.

The method may further include establishing a wireless communication connection with the mobile communication terminal located in a short distance.

The step of establishing the wireless communication connection may include receiving an identifier including at least one of a name, a model or a PIN code from at least one mobile communication terminal, displaying the identifier for the at least one mobile communication terminal Receiving a selection of the mobile communication terminal to be controlled among the one or more mobile communication terminals, and establishing a wireless communication connection with the selected mobile communication terminal among the one or more mobile communication terminals.

The step of displaying the identifier may further include searching for previously stored connection information corresponding to the identifier of the one or more mobile communication terminals and checking whether the connection information of the one or more mobile communication terminals Displaying the connection information, and displaying the identifier for the mobile communication terminal for which the connection information is not searched.

The method may further include receiving a modified identifier for a mobile communication terminal of the at least one mobile communication terminal from a user, and storing and / or displaying access information for the mobile communication terminal including the modified identifier The method comprising the steps of:

The method of claim 1, wherein the image comprises a jpeg stream, the step of receiving data including the image comprises receiving the data including the compressed jpeg stream, decompressing the compressed jpeg stream, And decoding the decompressed jpeg stream.

The data may include compressed skin data including at least one of a skin image of the mobile communication terminal, button coordinates, and event information corresponding to the button,

The step of displaying the image may include decompressing the skin data, analyzing the decompressed skin data, and displaying the skin image included in the skin data.

The method includes receiving a control command for controlling the mobile communication terminal from a user, transmitting the control command to the mobile communication terminal, receiving data including a result image of the control command from the mobile communication terminal, And displaying the resultant image on the other area.

The step of transmitting the control command to the terminal may further include searching for a button coordinate of the mobile communication terminal corresponding to the control command and event information corresponding to the button and transmitting the retrieved information to the terminal And a control unit.

In addition, the data may include horizontal or vertical operation mode information of the mobile communication terminal, and the step of displaying the image may include displaying the image on the entire area of the display unit when the operation mode is the horizontal operation mode .

The display unit may have an aspect ratio of a horizontal length to a vertical length of 21: 9, and the arbitrary ratio may be a ratio of the horizontal length of the display unit divided by 16: 5.

1. A TV for controlling a mobile communication terminal, comprising: a wireless communication unit for receiving data including an image from the mobile communication terminal; a display unit for displaying TV content in one area divided at an arbitrary ratio, And a control unit for dividing the display unit at the arbitrary ratio, displaying the TV contents in one divided area, and controlling the display unit to display the image in another area.

The mobile communication terminal may further include an input unit for receiving a control command for controlling the mobile communication terminal from a user, wherein the wireless communication unit transmits the control command to the mobile communication terminal, And the display unit receives the data including the resultant image, and the display unit displays the resultant image on the other area.

The display unit may have an aspect ratio of a horizontal length to a vertical length of 21: 9, and the arbitrary ratio may be a ratio of the horizontal length of the display unit divided by 16: 5.

According to the method and apparatus for controlling a mobile communication terminal using the TV disclosed in the present specification, a screen of a terminal is displayed on a screen area of a margin excluding TV content using a TV having a 21: 9 aspect ratio, The terminal screen can be seen on the TV efficiently.

In addition, according to the control method and apparatus of a mobile communication terminal using the TV disclosed in the present specification, a terminal is controlled using a terminal screen output to a TV, and various functions of the terminal are utilized in a TV, It is possible to more conveniently and conveniently control the terminal by using one electronic device even during the multi-tasking using.

1 is a block diagram showing a configuration of a TV according to an embodiment disclosed herein.
2 is a diagram illustrating a method of controlling a mobile communication terminal using a TV according to an embodiment disclosed herein.
3 is a diagram illustrating an example in which a TV according to an embodiment disclosed herein displays TV contents and an image received from a mobile communication terminal together.
4 is a flowchart illustrating a method of performing a wireless connection with one or more mobile communication terminals by a TV according to an embodiment disclosed herein.
5 is a diagram illustrating an example in which a TV according to an embodiment disclosed herein displays an identifier or access information of a mobile communication terminal.
6 is a diagram illustrating an example of receiving a modified identifier of a TV according to the embodiment disclosed herein.
FIG. 7 is a flowchart illustrating a method of controlling the mobile communication terminal based on a JPEG stream, according to an embodiment disclosed herein.
8 is a diagram illustrating an example of displaying a JPEG stream received from a mobile communication terminal according to an embodiment of the present invention.
9 is a diagram illustrating an example in which the TV disclosed in this specification downloads a moving image or an image file composed of a JPEG stream from the mobile communication terminal.
10 is a diagram showing an example in which the TV disclosed in this specification displays an image in a landscape mode.
11 is a flowchart illustrating a method of controlling the mobile communication terminal based on skin data of a TV according to an embodiment disclosed herein.
12 is a view illustrating an example of displaying a skin image received from a mobile communication terminal according to an embodiment of the present invention.
13 is a view illustrating an example of setting a focus area for receiving input from a TV according to the embodiment disclosed herein.
FIG. 14 is a diagram illustrating a result of a specific event of a mobile communication terminal performed by a TV according to an embodiment disclosed herein.

Embodiments disclosed herein may be configured as stand alone devices, as well as mobile terminals, telematics terminals, smart phones, portable electronic devices, Terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a notebook computer, a tablet PC, a Wibro electronic device, an Internet Protocol Television (IPTV) The present invention can be applied to a variety of electronic devices such as a device, a television, a 3D television, a video device, a telematics electronic device, a navigation electronic device, an AVN (Audio Video Navigation)

The embodiments disclosed herein may be implemented in the form of program instructions that may be executed on various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, file data, data structures, and the like, alone or in combination. Program instructions to be recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk, and a magnetic tape; optical media such as CD-ROM and DVD; magnetic recording media such as a floppy disk; Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The above hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and so forth.

It is noted that the technical terms used herein are used only to describe specific embodiments and are not intended to limit the invention. Also, the technical terms used herein should be interpreted in a sense that is generally understood by those skilled in the art to which the present disclosure relates, unless otherwise specifically defined in the present specification, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in this specification is an erroneous technical term that does not accurately express the concept of the technology disclosed in this specification, it should be understood that technical terms which can be understood by a person skilled in the art are replaced.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In this specification, "comprises" Or "include." Should not be construed to encompass the various components or steps described in the specification, and some of the components or portions may not be included, or may include additional components or steps And the like.

Further, the suffix "part" for a component used in the present specification is given or mixed in consideration of ease of specification, and does not have a meaning or role that is different from itself.

Further, in the description of the technology disclosed in this specification, a detailed description of related arts will be omitted if it is determined that the gist of the technology disclosed in this specification may be obscured. It is to be noted that the attached drawings are only for the purpose of easily understanding the concept of the technology disclosed in the present specification, and should not be construed as limiting the spirit of the technology by the attached drawings.

Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a TV according to an embodiment disclosed herein.

Referring to FIG. 1, the TV 100 includes a wireless communication unit 110, a controller 120, a memory 130, a display unit 140, and an input unit 150.

The wireless communication unit 110 allows the TV 100 to transmit and receive data to and from other electronic devices or servers using wireless communication. For example, the wireless communication unit 110 enables the TV 100 to perform wireless communication with the mobile communication terminal.

For this, the wireless communication unit 110 may select an appropriate communication method among the wireless communication methods according to the communication method used by the other electronic device.

 Here, the wireless communication may be a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a World Interoperability for Microwave Access (Wimax) (HSDPA), IEEE 802.16, Long Term Evolution (LTE), Wireless Mobile Broadband Service (WMBS), and the like. And may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like.

According to the embodiment of the present invention, the wireless communication unit 110 may receive data including an image from the mobile communication terminal, or an identifier including at least one of a name, a model, and a PIN code of the mobile communication terminal. The wireless communication unit 110 may transmit a control command for controlling the mobile communication terminal to the mobile communication terminal.

The controller 120 controls the overall operation of the TV 100. For example, the control unit 120 may control the TV 100 to transmit and receive data using the wireless communication with the mobile communication terminal.

According to the embodiment of the present invention, the control unit 120 can perform various controls for displaying an image received from the mobile communication terminal in one area of the display unit 140, which is divided at an arbitrary ratio have.

The memory 130 may include one or more types of storage media.

The memory 130 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk. The mobile communication terminal 100 may operate in association with a web storage that performs a storage function of the memory 130 on the Internet.

The memory 130 may store programs or commands for performing the functions of the mobile communication terminal 100 described above. The controller 120 may execute programs or commands stored in the memory 130 to transmit / receive data to / from the mobile communication terminal using wireless communication. A memory controller (not shown) may be used by the other components (for example, the controller 120) included in the mobile communication terminal 100 to access the memory 130.

According to an embodiment of the present invention, the memory 130 may include at least one of an identifier including at least one of a name, a model and a PIN code of the mobile communication terminal, skin data of the mobile communication terminal, Connection information can be stored. Also, the memory 130 may store a multimedia file received from the mobile communication terminal.

The display unit 140 may output information processed in the TV 100. For example, when the TV 100 receives image data from the mobile communication terminal by performing wireless communication with the mobile communication terminal, the display unit 140 displays a UI (User Interface) included in the image data, Or a GUI (Graphic User Interface).

The display unit 140 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT) LCD, an organic light-emitting diode (OLED) a flexible display, and a 3D display.

According to an embodiment disclosed herein, the display unit 140 may be divided at an arbitrary ratio to display TV content in one area of the divided display unit 140, and display the video in another area can do. At this time, the display unit 140 has a screen ratio of a horizontal length to a vertical length of 21: 9, and the arbitrary ratio may be a ratio of the horizontal length of the display unit 140 divided by 16: 5 have. Alternatively, the display unit 140 may display the image in the entire area of the display unit 140 when the operation mode of the mobile communication terminal is the horizontal operation mode.

The input unit 150 generates input data for controlling the operation of the TV 100 by a user. The input unit 150 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Also, the input unit 150 may be a pointing device of the TV 100.

According to the embodiment of the present invention, the input unit 150 may generate input data for controlling the mobile communication terminal. Also, the input unit 150 may generate input data for inputting, modifying, or storing authentication information or access information of the mobile communication terminal.

The components of the TV 100 shown in FIG. 1 are not essential components, and the components of the TV 100 may be realized by components having more or less components than those shown in FIG.

2 is a diagram illustrating a method of controlling a mobile communication terminal using a TV according to an embodiment disclosed herein.

Referring to FIG. 2, the TV 100 establishes a wireless communication connection with the mobile communication terminal located in a short distance (S210).

The TV 100 can establish a connection for wireless communication with the mobile communication terminal through the wireless communication unit 110. [ For example, the TV 100 may establish a connection for wireless communication with the terminal using a wireless communication technology or a short range communication technology supported by the mobile communication terminal. In particular, the TV 100 may perform wireless communication with the terminal using Wi-Fi technology.

According to the embodiment disclosed herein, the TV 100 can establish a wireless communication connection with a plurality of mobile communication terminals. To this end, the TV 100 receives an identifier from the plurality of mobile communication terminals, and can display the identifier list so that the user can select a mobile communication terminal to be controlled by the user among the plurality of mobile communication terminals. In addition, the TV 100 may modify the identifier or store and manage the access information including the identifier.

The details of the wireless communication connection between the TV 100 and the plurality of mobile communication terminals will be described below with reference to FIGS. 3 to 6. FIG.

Next, the TV 100 receives data including an image from the mobile communication terminal (s220).

The TV 100 can receive data including an image from the terminal using a wireless communication connection established through the wireless communication unit 110. [ The data may be encoded and / or compressed in response to the wireless communication means supported by the TV 100 and the mobile communication terminal, and may be decoded and / or decompressed in the TV 100 .

According to the embodiment disclosed herein, the image may be composed of a JPEG stream to be displayed on the TV 100 by the mobile communication terminal. The TV 100 decodes the JPEG stream, displays the decoded JPEG stream through the display unit 140, and controls the mobile communication terminal using the displayed image.

A method of controlling the mobile communication terminal based on the JPEG stream will be described in detail with reference to FIGS. 7 to 10. FIG.

In addition, according to the embodiment disclosed herein, the data may include compressed skin data including skin information, button coordinates, and event information corresponding to buttons of the mobile communication terminal. The TV 100 decompresses the skin data, analyzes the skin data, and displays the skin image through the display unit 140.

A method of controlling the mobile communication terminal based on the skin data will be described in detail with reference to FIGS. 11 to 14. FIG.

Thereafter, the TV 100 displays the image (s230).

The TV 100 may display the image received through the display unit 140. [ According to the embodiment of the present invention, the TV 100 can simultaneously display TV content received from a broadcasting station and the image received from the mobile communication terminal in the entire area of the screen of the display unit 140.

Specifically, the TV 100 can divide the display unit 140 (s231). The TV 100 may divide the display unit 140 at an arbitrary ratio.

According to the embodiment disclosed herein, the TV 100 may be configured to include the display unit 140 having an aspect ratio of 21: 9 in the ratio of the horizontal length to the vertical length. In general, since the aspect ratio of the TV contents is 16: 9, the TV 100 displays the TV contents without distortion, and at the same time, the width of the display unit 140 is set to 16: 5 Can be divided. Accordingly, the TV 100 can display the TV content in the 16: 9 area corresponding to the aspect ratio of the TV content, and display the TV image in the remaining 5: 9 area.

However, in the application of the present invention, the division is not limited to the above embodiment, and there is no limitation on the division ratio or the shape.

The TV 100 may output the TV content and the image (s232). 3, the TV 100 may display the TV content in one area 141 of the divided display unit 140 and display the TV image in another area 142. FIG.

According to the embodiment disclosed in the present specification, the TV 100 divides the horizontal length of the display unit 140 into 16: 5, and as shown in FIG. 3, The TV content can be displayed in the area 141 of the aspect ratio and the image can be displayed in the area 142 of the remaining 5: 9 aspect ratio. By doing so, the TV 100 can conveniently control the mobile communication terminal without being disturbed by the display of the image for control of the mobile communication terminal or the TV content is distorted.

In addition, according to the embodiment of the present invention, when the operation mode of the mobile communication terminal is the landscape mode, the TV 100 can display the image in the entire area of the display unit 140.

In addition, the TV 100 can confirm whether there is an input of a control command from the user (s240).

The TV 100 can check whether a user inputs a control command for controlling the mobile communication terminal through the input unit 150. [ The input may occur by clicking or flicking a specific button. In addition, the control command may be a control command for reproducing, stopping, zooming, rotating, or downloading the image or downloading the image to the TV 100, or a control for generating a specific event of the mobile communication terminal Command. Alternatively, the control command may be for viewing the image in a region 141 of a 16: 9 aspect ratio in which the TV content is displayed instead of the region 142 of the 5: 9 aspect ratio.

Then, the TV 100 can transmit the control command to the mobile communication terminal (s 250).

The TV 100 may transmit the control command to the mobile communication terminal through the communication unit 110 when the control command is input. The control command may be transmitted to the mobile communication terminal to control the mobile communication terminal. Alternatively, the control command can be directly executed in the TV 100. [

If there is no input of the control command, the TV 100 may continue to be in the standby mode until the input of the user occurs while receiving the data including the video.

The TV 100 may receive data including the result of performing the control command from the mobile communication terminal (s260). The TV 100 can receive data including images reproduced, stopped, enlarged and reduced by the control command from the mobile communication terminal. Alternatively, the TV 100 may receive an image including data including a resultant image transmitted from the mobile communication terminal, such as a multimedia file, or a specific event.

The TV 100 may display the resultant image (s270). The TV 100 may display the received performance result image on the display unit 140. [ At this time, the TV 100 may display the resultant image in a divided region 142 of the display unit 140. [

Hereinafter, a specific embodiment of control of the mobile communication terminal using the TV 100 will be described with reference to the drawings.

4 is a flowchart illustrating a method of performing a wireless connection with one or more mobile communication terminals by a TV according to an embodiment disclosed herein.

Referring to FIG. 4, the TV 100 receives an identifier (s211). The TV 100 may receive an identifier for identifying a specific mobile communication terminal from one or more mobile communication terminals from one or more mobile communication terminals. The identifier may include at least one of a name, a model or a PIN code of the mobile communication terminal.

Then, the TV 100 searches for connection information (s212). The TV 100 may search for connection information corresponding to one or more identifiers of the mobile communication terminal. The connection information may include the identifier, the skin data, the connection password, and the like of the mobile communication terminal, which are stored at the time of connection when the mobile communication terminal has been connected to the TV 100 in the past.

If the access information is retrieved, the TV 100 can display the access information corresponding to one or more mobile communication terminals (s213).

On the contrary, if the access information is not retrieved, the TV 100 can display the identifier received from one or more mobile communication terminals (s214). At this time, when the mobile communication terminal is connected at a later time, the TV 100 may store the received identifier to utilize the identifier of the mobile communication terminal and the connection information for performing the additional operation.

The identifier or the display of the connection information may be displayed in the form of a list or a chart, or may be expressed in the form of a slide UI icon as shown in FIG. 5, the TV 100 may display a name 510, a model 520, and a skin data image 530 of the mobile communication terminal with respect to one or more mobile communication terminals, A connection selection icon 540 of the communication terminal and the TV 100, and an icon 550 for modifying the connection information of the mobile communication terminal. In addition, if the access information is not retrieved for the mobile communication terminal, the TV 100 may display (560) the access information as shown in FIG. 5.

The TV 100 may receive a modified identifier for any one of the one or more mobile communication terminals from the user (s215). As shown in FIG. 6, the TV 100 may receive a modified identifier for having a specific identifier that the user can identify by himself / herself with respect to the mobile communication terminal. The modified identifier may be related to the name 620 of the mobile communication terminal or a connection password for the mobile communication terminal.

At this time, the TV 100 can input (610) a password for allowing modification to the user to modify the identifier of the arbitrary mobile communication terminal. This may be for enhancing security by preventing modification of the identifier of the mobile communication terminal due to an unauthenticated user. The password may be a user password set in the mobile communication terminal or a user password set through the TV 100.

When receiving the modified identifier, the TV 100 may store and / or display the modified identifier (s216). The TV 100 may store the received identifier to utilize the identifier of the mobile communication terminal and the connection information for performing the additional task when the mobile communication terminal is connected later. Also, the TV 100 may display the modified identifier for the arbitrary mobile communication terminal, instead of the identifier received from the mobile communication terminal.

The TV 100 can receive a selection of a mobile communication terminal to be controlled by the user (s217). The input may be generated by clicking on the connection selection icon 540 or by inputting the identifier.

Finally, the TV 100 can establish a connection with the selected mobile communication terminal (s218). The TV 100 may establish a wireless communication connection for establishing data communication with the selected mobile communication terminal. The TV 100 may receive data including an image from the mobile communication terminal through the wireless communication connection.

FIG. 7 is a flowchart illustrating a method of controlling the mobile communication terminal based on a JPEG stream, according to an embodiment disclosed herein.

Referring to FIG. 7, the TV 100 may receive data including a compressed JPEG stream from the mobile communication terminal (s2211). The JPEG stream is decoded in order to transmit the multimedia file stored in the mobile communication terminal to the TV 100. The JPEG stream is a format suitable for transmission in the wireless communication connection established between the TV 100 and the mobile communication terminal Lt; / RTI > For example, referring to FIG. 8, the JPEG stream may be a moving image or an image file stored in the mobile communication terminal.

Then, the TV 100 can decompress the data including the compressed JPEG stream (s2212). The TV 100 decompresses the compressed JPEG stream for data transmission so that the TV stream can be processed by the TV 100.

Thereafter, the TV 100 decodes the decompressed JPEG stream (s2213). The TV 100 may decode the decompressed JPEG stream into a format that can be output from the display unit 140 of the TV 100. The TV 100 can convert the ratio of the horizontal and vertical lengths so that the JPEG stream can be displayed in one divided area of the display unit 140 and decode it. For example, referring to FIG. 8, the TV 100 displays a moving image or an image file having a ratio of 5: 9 so that the decompressed JPEG stream can be displayed in a divided region of the display unit 140 Lt; / RTI >

The TV 100 can display the decoded JPEG stream on the display unit 140 (S2214). The TV 100 can display the JPEG stream in one divided area 811 of the display unit 140 as shown in FIG. At this time, the TV 100 may display the TV content together with another divided area 812 of the display unit 140. [

The TV 100 can perform control based on the JPEG stream (s2215). The control may be any one of reproduction, enlargement / reduction, next image viewing, and rotation of the JPEG stream. Alternatively, the control may be for downloading a moving image or an image file composed of the JPEG stream to the TV 100.

The TV 100 may receive a control command from the user to perform the control. The input may be generated by the pointing device of the TV 100. The input may be generated by clicking, double-clicking, flicking, or dragging-and-dropping the JPEG stream displayed on the display unit 140. Such input may occur by pressing or releasing a jog switch or button provided on the pointing device corresponding to each input, or by flicking in a specific direction.

Referring to FIG. 8, the TV 100 displays the JPEG stream displayed in one divided area 811 of the display unit 140, the playback of the moving image when the JPEG stream is moving image, If the stream is an image, a control command for performing a slide show of the image may be input.

The TV 100 may transmit the control command to the mobile communication terminal to be performed in the mobile communication terminal, or may be directly performed in the TV 100. When the control command is transmitted to the mobile communication terminal, the TV 100 may receive data including the result of performing the control command from the mobile communication terminal.

The execution result image may be any one of a JPEG stream reproduced, an enlarged / reduced image, a next moving image or an image, and a rotated image corresponding to the control command. Alternatively, when the control command is for downloading a moving image or an image file composed of the JPEG stream to the TV 100, the TV 100 receives data including the moving image or the image file from the mobile communication terminal, Or data including an image informing that an image file is being transmitted.

Referring to FIG. 8, the TV 100 may receive a screen on which the moving picture is reproduced when the JPEG stream is moving picture from the mobile communication terminal in response to the control command.

9 is a diagram illustrating an example in which the TV disclosed in this specification downloads a moving image or an image file composed of a JPEG stream from the mobile communication terminal.

Referring to FIG. 9, the TV 100 receives an image composed of a JPEG stream from the mobile communication terminal, and displays the image in a divided region 911 of the display unit 140. The TV 100 may receive a control command for downloading the image to the TV 100. The input may be generated by a drag and drop method 920 of dragging the image through the pointing device of the TV 100 and dropping the image onto another divided area 912 of the display unit 140.

Upon receipt of the control command, the TV 100 transmits the control command to the mobile communication terminal and receives the JPEG stream file constituting the image from the mobile communication terminal. While the file is being received, the TV 100 may separately display an icon 913 indicating that the image is being transmitted. The TV 100 can store the received stream file or play it on the TV 100.

10 is a diagram showing an example in which the TV disclosed in this specification displays an image in a landscape mode.

Referring to FIG. 10, the TV 100 may receive an image composed of a JPEG stream from the mobile communication terminal. At this time, the TV 100 may receive horizontal or vertical operation mode information of the mobile communication terminal from the mobile communication terminal.

When the operation mode is the vertical operation mode, the TV 100 can display the image in one region 1001 of the divided region of the display unit 140. [

When the operation mode is the horizontal operation mode, the TV 100 can display the image in the entire area 1003 of the display unit 140. [ Therefore, the TV 100 can be utilized for the presentation of the TV 100 or for the appreciation of moving pictures.

11 is a flowchart illustrating a method of controlling the mobile communication terminal based on a JPEG stream, according to an embodiment disclosed herein.

Referring to FIG. 11, the TV 100 may receive compressed skin data from the mobile communication terminal (step s2221).

The skin data includes skin information of the mobile communication terminal. The skin data may include a skin image of the mobile communication terminal, a function of a button and / or an icon included in the mobile communication terminal, a position and coordinates of a button and / Or icons, and may be compressed in a form suitable for transmission in a wireless communication connection established between the TV 100 and the mobile communication terminal.

Then, the TV 100 can decompress the skin data (s2222). The TV 100 decompresses the compressed skin data for data transmission so that the TV 100 can process the skin data.

Thereafter, the TV 100 may analyze and display the decompressed skin data (s2223).

The TV 100 decompresses the skin data and displays the skin image of the mobile communication terminal, the functions of the buttons and / or icons provided in the mobile communication terminal, the coordinates of the buttons and / or icons Button, and / or icon, and display the skin image that can be displayed on the display unit 140. [0053] FIG. 12, the TV 100 may display the skin image in one divided region 1201 of the display unit 140. [0053] FIG. At this time, the TV 100 may display the TV content together with another divided area 1202 of the display unit 140.

The TV 100 may control the mobile communication terminal based on the skin data (s2224).

The control may be for performing a specific event of the mobile communication terminal based on the skin data.

The TV 100 may receive a control command from the user to perform the control. The input may be generated by the pointing device of the TV 100. The input may be generated by clicking, double-clicking, flicking, or dragging-and-dropping a button and / or an icon displayed on the skin image displayed on the display unit 140. Such input may occur by pressing or releasing a jog switch or button provided on the pointing device corresponding to each input, or by flicking in a specific direction.

12, the TV 100 corresponds to the button 1203 or the icon 1204 of the mobile communication terminal with respect to the skin image displayed in the divided area 1201 of the display unit 140 The control of the mobile communication terminal.

When the user operates the pointing device to input the control command, the size of the button or icon 1301 of the mobile communication terminal in the skin image displayed in the divided region 1201 of the display unit 140 The operation may not be easy. Therefore, the TV 100 can set a focus area 1302, which is set to be selected as the button or icon 1301, to be wider than the size of the button or icon 1301, as shown in FIG.

The TV 100 can confirm the coordinates of the display unit 140 when the input is generated. The TV 100 searches for a button and / or an icon of the mobile communication terminal corresponding to the coordinates, and confirms the function or event information of the corresponding button and / or icon based on the skin data.

The TV 100 may generate a control command for the corresponding function or event and transmit the control command to the mobile communication terminal so that the function or event is performed in the mobile communication terminal.

Also, the TV 100 may receive data including the result of performing the control command from the mobile communication terminal. The execution result image may be a result image in which a specific event of the mobile communication terminal is performed corresponding to the control command.

For example, referring to FIG. 14, when a user performs an input 1401 for pressing an icon for confirming a text message in the skin image displayed on the display unit 140, A control command for confirming a text message can be transmitted to the terminal. Upon receiving the control command, the mobile communication terminal opens a text message window in the mobile communication terminal and transmits a performance result screen with a text message window to the TV 100 so that the user can confirm the text message.

The TV 100 receiving the performance result screen may display the performance result screen on the display unit 140. [ At this time, the TV 100 may display the performance result screen in a divided area 1402 of the display unit 140. [

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: TV 110: wireless communication unit
120: control unit 130: memory
140: display unit 150: input unit

Claims (13)

A method of controlling a mobile communication terminal using a TV,
Receiving data including an image from the mobile communication terminal;
Identifying an operation mode of the mobile communication terminal; And
Displaying the image included in the data on the entire screen of the TV display unit according to the operation mode of the identified mobile communication terminal, dividing the display unit of the TV into an arbitrary ratio, Displaying TV content and an image included in the data,
Wherein the data including the image includes:
Wherein the mobile communication terminal includes operation mode information of the mobile communication terminal,
The step of identifying an operation mode of the mobile communication terminal comprises:
And a step of identifying whether the operation mode of the mobile communication terminal is the horizontal operation mode or the portrait operation mode based on the operation mode information received together with the data including the image . The method according to claim 1,
Further comprising the step of establishing a wireless communication connection with the mobile communication terminal located in a short distance. delete delete delete The method of claim 1,
jpeg stream,
Wherein the step of receiving data including the image comprises:
Receiving the data including the compressed jpeg stream;
Decompressing the compressed jpeg stream; And
And decrypting the decompressed jpeg stream using the decompressed jpeg stream. 2. The method of claim 1,
And compressed skin data including at least one of a skin image of the mobile communication terminal, button coordinates, and event information corresponding to the button,
Wherein the displaying comprises:
Decompressing the skin data;
And analyzing the decompressed skin data to display the skin image included in the skin data. 8. The method according to claim 6 or 7,
Receiving a control command for controlling the mobile communication terminal from a user;
Transmitting the control command to the mobile communication terminal;
Receiving data including an execution result of the control command from the mobile communication terminal; And
And displaying the execution result image on the other area. The method according to claim 1,
Wherein the displaying comprises:
When the operation mode of the mobile communication terminal is the horizontal operation mode, the image is displayed on the entire area of the display unit,
Wherein when the operation mode is the vertical operation mode, the display unit is divided and the TV content and the image included in the data received from the mobile communication terminal are displayed in the divided one area and the other area, respectively A control method of a mobile communication terminal using a TV. The display device according to claim 1,
A ratio of the horizontal length to the vertical length is 21: 9,
The above-
Wherein the ratio of the horizontal length of the display unit to the horizontal length of the display unit is 16: 5. A TV receiving operation mode information of the mobile communication terminal together with data including a video from the mobile communication terminal,
A wireless communication unit for establishing a wireless communication connection with the mobile communication terminal;
A display unit displaying an image received from the mobile communication terminal in the entire area or displaying the TV content in one area divided at an arbitrary ratio and displaying the image in another area; And
And displaying the image received from the mobile communication terminal on the entire area based on the identified operation mode, or displaying the image received from the mobile communication terminal on the basis of the identified operation mode, And controlling the display unit to display the TV content and the image received from the mobile communication terminal in the divided one area and the other area, respectively. 12. The method of claim 11,
Further comprising an input unit for receiving a control command for controlling the mobile communication terminal from a user,
The wireless communication unit includes:
The control command is transmitted to the mobile communication terminal, the data including the execution result of the control command is received from the mobile communication terminal,
The display unit includes:
And displaying the execution result image on the other area. The display device according to claim 12,
A ratio of the horizontal length to the vertical length is 21: 9,
The above-
And a ratio of the horizontal length of the display unit divided by 16: 5.

Images