KR20170057793A

KR20170057793A - Display device and operating method thereof

Info

Publication number: KR20170057793A
Application number: KR1020150161413A
Authority: KR
Inventors: 김정심
Original assignee: 엘지전자 주식회사
Priority date: 2015-11-17
Filing date: 2015-11-17
Publication date: 2017-05-25
Also published as: KR101772288B1

Abstract

A method of operating a display device is disclosed. A method of operating a display device according to an embodiment of the present invention includes receiving from a remote control device a first control signal including information on a motion of the remote control device, Switching an input provided to the display device to an external input when a pointer moves from an area of the screen of the display device to an area outside of the screen, switching the input provided to the display device to the display device, Receiving a first image from a providing first external device and displaying the first image, receiving a second control signal from a remote control device, receiving, based on the second control signal, To the first external device controlled according to the command, 2 image, and displaying the second image.

Description

[0001] DISPLAY DEVICE AND OPERATING METHOD THEREOF [0002]

The present invention relates to a display device and a method of operating the same. More particularly, the present invention relates to a display device capable of controlling an external device that switches to an external input when coordinates of a pointer that is changed according to a motion of the remote control device are out of a screen area and provides an external input, and a method of operating the same .

In recent years, digital TV services using wired or wireless communication networks have become popular. The digital TV service can provide various services that can not be provided by the existing analog broadcasting service.

For example, in the case of IPTV (Internet Protocol Television) service, which is one kind of digital TV service, it provides a bidirectionality allowing the user to actively select the type of viewing program, viewing time, and the like. The IPTV service may provide various additional services such as Internet search, home shopping, online game, etc. based on the bidirectionality.

In recent years, there has been an increasing number of cases in which a TV is connected to a plurality of external devices to receive and display contents from an external device connected to the TV, or displays a screen of an external device through a TV.

Conventionally, when a user input for switching to an external input is received, a plurality of interfaces are displayed. When the user selects a specific interface, the input is switched to an external device connected through the interface selected by the user. Respectively.

However, in the recent trend that various external devices can be connected to the TV, there is a problem that it is difficult to intuitively recognize the user's specific input to which external device is to be switched.

In addition, since the user has to select one of a plurality of external inputs by switching the screen to a screen displaying a plurality of external inputs through a user operation and again performing a user operation, There has been a problem in that the user has to operate several times to switch the external input.

In addition, in order to control an external device that provides an external input in the case of switching to an external input, it may be operated by an input unit mounted on the external device, by a remote controller capable of controlling the external device, There is a problem in that it is necessary to purchase and use an integrated remote controller capable of controlling the remote control device.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide an external device that switches to an external input when the coordinates of a pointer, which is changed according to a motion of the remote control device, And a method of operating the same.

A method of operating a display device according to an embodiment of the present invention includes receiving from a remote control device a first control signal including information on a motion of the remote control device, Switching an input provided to the display device to an external input when a pointer moves from an area of the screen of the display device to an area outside of the screen, switching the input provided to the display device to the display device, Receiving a first image from a providing first external device and displaying the first image, receiving a second control signal from a remote control device, receiving, based on the second control signal, To the first external device controlled according to the command, 2 image, and displaying the second image.

Meanwhile, a display device according to an embodiment of the present invention includes a display unit for displaying an image, a user input interface unit for receiving a control signal from the remote control device, an external input interface unit for receiving an input provided to the display device, And a controller for receiving a first control signal including information on the motion of the remote control device from the remote control device, wherein a pointer moving in accordance with the motion of the remote control device is moved from an area of the screen of the display device to an area outside the screen A first external device that receives input from the first external device and provides an input to the display device when the input provided to the display device is switched, A second control signal And a controller for receiving a call and transmitting a command to the first external device based on the second control signal and receiving and displaying a second image from the first external device controlled according to the command have.

1 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present invention.
2 is a block diagram of a remote control device according to an embodiment of the present invention.
3 shows an example of an actual configuration of a remote control apparatus according to an embodiment of the present invention.
4 shows an example of utilizing a remote control device according to an embodiment of the present invention.
5 is a view for explaining a display system including a display device and an external device according to an embodiment of the present invention.
6 is a diagram for explaining a method of operating a display device according to an embodiment of the present invention.
FIGS. 7 to 8 are diagrams for explaining the boundary of a screen to which an external device can be mapped, the direction in which an external device can be mapped, and the boundary and direction in which an external device can be mapped.
8 is a diagram for explaining a plurality of directions in which an external device can be mapped according to an embodiment of the present invention.
9 is a view showing a display screen in a state where a plurality of external devices communicating with the display device are detected according to an embodiment of the present invention.
10 is a diagram for explaining a method of mapping a boundary corresponding to each of a plurality of external devices to each of a plurality of external devices according to an embodiment of the present invention.
11 is a diagram for explaining a method of mapping a direction corresponding to each of a plurality of external devices to each of a plurality of external devices according to an embodiment of the present invention.
12 is a diagram for explaining a method of mapping boundaries and directions to an external device according to an embodiment of the present invention.
13 to 15 are views for explaining a method of displaying at least one of boundaries and directions in which a plurality of external devices are mapped according to an embodiment of the present invention.
16 is a diagram for explaining a method of obtaining coordinates of a pointer corresponding to a motion of a remote control apparatus according to an embodiment of the present invention.
17 to 18 are diagrams for explaining a method of switching an input provided to a display device to an external input when a pointer moves out of a screen area according to an embodiment of the present invention.
19 is a diagram for explaining a method of switching to external input when a plurality of external devices are mapped to a plurality of boundaries of an area of a screen.
20 is a diagram for explaining a method of switching to an external input when each of a plurality of external devices is mapped in a plurality of directions in which the pointer is out of the screen area.
21 is a diagram for explaining a method of switching external inputs when a plurality of external devices are mapped to a plurality of boundaries and directions of an area of a screen.
22 to 24 are diagrams for explaining various methods for determining whether a pointer is out of a screen area according to an embodiment of the present invention.
25 is a diagram for explaining a display screen when an input provided to a display device is switched to an external input according to an embodiment of the present invention.
26 is a view for explaining an operation method of an external device when an input provided to a display device is switched to an external input according to an embodiment of the present invention.
27 is a flowchart illustrating a process of displaying a pointer, acquiring the coordinates of a pointer based on a motion of the remote control device, and switching to an external input when the pointer moves out of the screen area, according to an embodiment of the present invention FIG.
28 is a diagram for explaining a method of displaying an external device corresponding to a specific boundary so that the pointer can be distinguished when the pointer passes the specific boundary and is out of the screen area.
29 is a diagram for explaining a method for switching input again when an input provided to a display device is switched to an external input.
30 is a diagram for explaining a new external device mapping method when a new external device is detected according to an embodiment of the present invention.
31 is a view for explaining a method of operating a display device according to another embodiment of the present invention.
32 is a diagram for explaining an operation method in the case where one boundary corresponds to a plurality of external apparatuses.
33 is a view for explaining a method of operating a display device according to another embodiment of the present invention.
34 is a diagram for explaining a mapping method of an external device according to another embodiment of the present invention.
35 is a diagram for explaining a method of mapping the position of an external device and switching an input according to movement of a pointer according to another embodiment of the present invention.
FIG. 36 is a view for explaining a method of operating a display device according to another embodiment of the present invention.
37 is a diagram for explaining a method of receiving and displaying an image from an external device that provides an input to a display device according to an embodiment of the present invention.
FIG. 38 is a diagram for explaining a method of displaying a pointer or another image together with an image received from an external device.
39A to 39D are diagrams for explaining a method of receiving a second control signal from a remote control device and transmitting a command to a first external device based on a second control signal according to an embodiment of the present invention.
Figs. 40A to 40E are diagrams for explaining areas corresponding to screens of a first external device, according to various embodiments of the present invention. Fig.
41 is a diagram for explaining a method of converting an area and a coordinate corresponding to a screen of the first external device.
42 is a view for explaining a method of the display device receiving and displaying an image displayed on the screen of the first external device;
43 to 44 are diagrams for explaining a method of selecting an area where a pointer is located on a screen of a first external device according to an embodiment of the present invention.
FIGS. 45A and 45B are diagrams for explaining an operation method in the case where a pointer moved to an area outside the screen moves back to an area inside the screen, according to an embodiment of the present invention.
47A and 47B are views for explaining a control method for an external device when the second external device does not include a display device, according to another embodiment of the present invention.
48 is a diagram for explaining an operation in the case where the third external device providing input to the display device 100 is a cellular phone.
49 is a diagram for explaining a method of receiving a user input for selecting a specific area on the screen of the display device.
50 is a diagram showing a third external device 580 and a display device which have received an instruction.

Hereinafter, embodiments related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The display device according to the embodiment of the present invention is an intelligent display device that adds a computer support function to a broadcast reception function, for example, and is equipped with a function of inputting a handwriting, a touch screen Or an interface that is more convenient to use than a space remote controller or the like. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Therefore, the display device described in the present invention can freely add or delete various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, an HBBTV, a smart TV, an LED TV, an OLED TV, or the like, and may be applied to a smartphone as the case may be.

1 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present invention.

1, a display device 100 includes a broadcast receiver 130, an external device interface 135, a storage 140, a user input interface 150, a controller 170, a display 180, An audio output unit 185, a power supply unit 190, and a communication unit 195.

The broadcast receiving unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

The tuner 131 can tune to a specific broadcast channel according to the channel tuning command. The tuner 131 may receive a broadcast signal for the selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and can restore the separated video signal, audio signal, and data signal into a form capable of outputting.

The external device interface unit 135 may receive an application or application list in an adjacent external device and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and the peripheral device. The external device interface unit 135 may receive the content stored in the peripheral device and transmit the received content to the controller 170. [

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired / wireless network including the Internet network. The network interface unit 133 can transmit or receive data to another user or another electronic device via the network connected thereto or another network linked to the connected network.

In addition, some content data stored in the display device 100 can be transmitted to another user registered in the display device 100 or a selected one of the other electronic devices or selected electronic devices.

The network interface unit 133 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server.

The network interface unit 133 may receive content or data provided by the content provider or the network operator. That is, the network interface unit 133 can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 can receive update information and an update file of the firmware provided by the network operator, and can transmit data to the Internet or a content provider or a network operator.

The network interface unit 133 can select and receive a desired application among applications open to the public via the network.

The storage unit 140 stores programs for signal processing and control in the controller 170, and can store image-processed video, audio, or data signals.

The storage unit 140 may perform a function for temporarily storing video, audio, or data signals input from the external device interface unit 135 or the network interface unit 133, It may also store information about the image.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 133. [

The display apparatus 100 may reproduce and provide a content file (a moving picture file, a still picture file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or may transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 may be implemented by various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, RF (Radio Frequency) communication, and infrared (IR) It is possible to receive and process control signals such as power on / off, channel selection, screen setting, and the like from the remote control device 200, or transmit control signals from the control unit 170 to the remote control device 200. [

The user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

In addition, the control unit 170 can control the overall operation in the display device 100. [

The control unit 170 may control the display device 100 according to a user command or an internal program input through the user input interface unit 150. The control unit 170 accesses the network and displays a list of applications or applications desired by the user, So that it can be downloaded into the portable terminal 100.

The control unit 170 may output the video or audio signal processed through the channel information selected by the user through the display unit 180 or the audio output unit 185.

The control unit 170 controls the operation of the external device through the external device interface unit 135 according to an external device video playback command received through the user input interface unit 150. For example, So that a video signal or a voice signal can be output through the display unit 180 or the audio output unit 185.

The control unit 170 may control the display unit 180 to display an image and may output the broadcast image input through the tuner 131 or the external input through the external device interface unit 135, The image input through the network interface unit or the image stored in the storage unit 140 may be displayed on the display unit 180. [ In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the controller 170 may control the content stored in the display device 100, the received broadcast content, or external input content input from the outside to be reproduced, and the content may be a broadcast image, an external input image, , A still image, a connected web screen, and a document file.

The display unit 180 converts the video signal, the data signal, the OSD signal, the video signal, the data signal, and the like received from the external device interface unit 135 into R, G, and B signals, respectively, Signal can be generated.

The communication unit 195 can exchange information with other display devices through wired or wireless communication. The communication unit 195 may include a short-range communication module. The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

The communication unit 195 may be included in the control unit 170.

On the other hand, the display device 100 shown in FIG. 1 is only an embodiment of the present invention. Some of the components shown may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented.

That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

1, the display apparatus 100 may include a tuner 131 and a demodulator 132 and may include a network interface unit 133 or an external device interface unit (not shown) 135 to reproduce the image.

For example, the display apparatus 100 may be divided into an image processing apparatus such as a set-top box for receiving broadcast signals or contents according to various network services, and a content reproducing apparatus for reproducing contents inputted from the image processing apparatus Can be implemented.

In this case, the operation method of the display device according to the embodiment of the present invention to be described below may be applied not only to the display device 100 as described with reference to FIG. 1, but also to the image processing device such as the separated set- 180, and an audio output unit 185. The content playback apparatus may be implemented by any one of the above-described content playback apparatuses.

The display device 100 may include an external input interface unit (not shown) that performs both functions of the external device interface unit 135 and the communication unit 173. [ That is, the display device 100 may communicate with an external device connected through an external input interface unit (not shown) or may perform wireless communication with an external device through an external input interface unit (not shown).

Next, a remote control apparatus according to an embodiment of the present invention will be described with reference to Figs. 2 to 3. Fig.

FIG. 2 is a block diagram of a remote control apparatus according to an embodiment of the present invention, and FIG. 3 shows an example of an actual configuration of a remote control apparatus 200 according to an embodiment of the present invention.

2, the remote control apparatus 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260 A storage unit 270, a control unit 280, and a voice acquiring unit 290. [0034]

Referring to FIG. 2, the wireless communication unit 225 transmits / receives a signal to / from any one of the display devices according to the embodiments of the present invention described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to the RF communication standard and is capable of transmitting and receiving signals with the display device 100 according to the IR communication standard And an IR module 223. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals with the display device 100 according to the Bluetooth communication standard. The remote control apparatus 200 is provided with an NFC module 227 capable of transmitting and receiving signals to and from the display apparatus 100 in accordance with a NFC (Near Field Communication) communication standard. In accordance with a WLAN (Wireless LAN) communication standard, And a WLAN module 229 that can send and receive signals to and from the device 100.

The remote control device 200 transmits a signal containing information on the motion and the like of the remote control device 200 to the display device 100 through the wireless communication unit 220.

On the other hand, the remote control device 200 can receive a signal transmitted from the display device 100 through the RF module 221 and can transmit power to the display device 100 via the IR module 223, Off, channel change, volume change, and the like.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the display device 100 to the remote control device 200 by operating the user input unit 230. [ When the user input unit 230 has a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through the push operation of the hard key button. This will be described with reference to FIG.

Referring to FIG. 3, the remote control apparatus 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, A channel change button 237, an OK button 238, and a back button 239. [

The fingerprint recognition button 212 may be a button for recognizing the fingerprint of the user. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for controlling the volume of the volume output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

Fig. 2 will be described again.

When the user input unit 230 has a touch screen, the user can touch a soft key of the touch screen to input a command related to the display device 100 to the remote control device 200. [ In addition, the user input unit 230 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243 and the gyro sensor 241 may sense information on the motion of the remote control device 200. [

For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 on the basis of the x, y, and z axes, and the acceleration sensor 243 may sense the movement speed of the remote control device 200 And the like can be sensed. The remote control device 200 may further include a distance measuring sensor to sense the distance from the display unit 180 of the display device 100. [

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the display device 100. [ The user can recognize whether the user input unit 235 is operated or whether the display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when the user input unit 235 is operated or a signal is transmitted to and received from the display device 100 through the wireless communication unit 225, a vibration module 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

In addition, the power supply unit 260 supplies power to the remote control device 200, and if the remote control device 200 is not moved for a predetermined time, the power supply is interrupted to reduce power consumption. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band .

The control unit 280 of the remote control device 200 stores information on a frequency band and the like capable of wirelessly transmitting and receiving a signal with the display device 100 paired with the remote control device 200 in the storage unit 270, can do.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225 100).

Also, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

The voice acquisition unit 290 may include at least one microphone 291 and may acquire voice through the microphone 291.

Next, Fig. 4 will be described.

4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

4A illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. In FIG.

The user can move or rotate the remote control device 200 up, down, left or right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

4B illustrates that when the user moves the remote controller 200 to the left, the pointer 205 displayed on the display unit 180 of the display apparatus 100 moves to the left correspondingly.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from the information about the motion of the remote control device 200. [ The display device 100 can display the pointer 205 so as to correspond to the calculated coordinates.

4C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is depressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed.

Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed.

On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Further, the recognition of the upward, downward, and leftward / rightward movement can be excluded when a specific button in the remote control device 200 is pressed. That is, when the remote control device 200 moves away from or approaches the display unit 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to a point on a horizontal axis or a vertical axis on the display unit 180 or may be displayed corresponding to a plurality of points such as a line or a surface Do.

Next, a display system according to an embodiment of the present invention will be described with reference to FIG.

5 is a view for explaining a display system including a display device and an external device according to an embodiment of the present invention.

The display apparatus 100 may be connected to a plurality of external apparatuses 510, 520, 530, 540, 550, 560, 570 through an external apparatus interface unit 135. To this end, the external device interface unit may include various input ports such as HDMI, USB, Compsite, Component, optical / optical, RF, and RS232.

The display device 100 may communicate with a plurality of external devices 510, 520, 530, 540, 550, 560, and 570 through a communication unit 195.

5, a plurality of external devices 510, 520, 530, 540, 550, 560 and 570 are connected to the USB 510, the PC 520, the external hard disk 530, the Blu- ray player 540, The digital camera 560 and the notebook 570. However, the present invention is not limited to this, and a plurality of external devices may be connected to a display device such as a game machine, a camcorder, a smart phone, a tablet PC, an MP3 player, an audio player, 100 may be any device capable of providing an external input to the display device 100.

On the other hand, the display apparatus 100 can receive and display external inputs from a plurality of external apparatuses 510, 520, 530, 540, 550, 560, 570 through the external apparatus interface unit 135 or the communication unit 195 have.

For example, when the display apparatus 100 receives an external input from the PC 520, the control unit 170 receives the image displayed on the PC from the PC 520 and displays the received image on the display unit 180).

As another example, when the display device 100 receives an external input from the USB 510, the control unit 170 receives the contents stored in the USB 510 from the USB 510 and outputs the received contents The display unit 180 and the audio output unit 185 can be controlled.

As another example, when the display apparatus 100 receives an external input from the set-top box 550, the controller 170 receives the image or voice output from the set-top box 550, And outputs the received voice through the audio output unit 185.

5, external input is received from a plurality of external devices 510, 520, 530, 540, 550, 560, and 570 that communicate with the display device 100. However, the present invention is not limited thereto. Specifically, the " external input " described in the present specification includes not only contents received from an external device directly connected to the display device 100, but also content input through a broadcast input through the tuner 131 or a network interface can do.

6 is a diagram for explaining a method of operating a display device according to an embodiment of the present invention.

Referring to FIG. 6, a method of operating a display device according to an exemplary embodiment of the present invention includes sensing a plurality of external devices communicating with a display device (S610), receiving a plurality of external devices (S620) a step of receiving a user input for mapping at least one of an angle and a boundary corresponding to a plurality of external devices (S620); and mapping and storing at least one of angles and boundaries to each of a plurality of detected external devices S630), displaying at least one of an angle and a boundary corresponding to each of the plurality of external devices (S640), displaying the pointer on the screen (S650), receiving information about the motion of the remote control device S660), acquiring the coordinates of the pointer corresponding to the motion of the remote control device (S670), and obtaining the coordinates of the pointer corresponding to the motion of the remote control device If on the basis of the coordinates of the pointer out of the area to which the pointer corresponds to the screen it may include a step (S680) for switching the input to the external input provided to the display device.

Before describing step S610 of sensing a plurality of external devices, a plurality of directions or a plurality of boundaries that can be mapped to a plurality of external devices will be described.

FIGS. 7 to 8 are diagrams for explaining the boundary of a screen to which an external device can be mapped, the direction in which an external device can be mapped, and the boundary and direction in which an external device can be mapped.

7 is a diagram for explaining a plurality of boundaries of an area of a screen according to an embodiment of the present invention.

7A, the boundary between the area 710 of the screen and the area other than the area of the screen is indicated by a dotted line.

On the other hand, the entire boundary between the area 710 of the screen and the area other than the area of the screen may include a plurality of boundaries 711, 712, 713 and 714 to which an external device can be mapped.

Specifically, the entire boundary between the area 710 of the screen and the area other than the area of the screen is divided into a plurality of boundaries 711, 712, 713, 714).

As shown in Fig. 7A, the plurality of boundaries 711, 712, 713, and 714 to which the external device can be mapped may include a border 711 in the " up " , A boundary 712 in the " right " direction in the area of the screen, a boundary 713 in the area of the screen in the lower direction, and a boundary 714 in the " .

However, the present invention is not limited thereto. For example, as shown in FIG. 7B, a plurality of boundaries 721, 722, 723, 724, 725, 726, 727, 728, 729, 730, A plurality of boundaries 721, 722 and 723 in the " up " direction in the screen region, a plurality of boundaries 724 and 725 in the " (726, 727, 728), and a plurality of "left" boundaries 729, 730 in the area of the screen.

That is, the plurality of boundaries 721, 722, 723, 724, 725, 726, 727, 728, 729, 730 to which each of the plurality of external apparatuses can be mapped may include at least one boundary in the first direction, At least one boundary in the second direction in the area of the screen, at least one boundary in the third direction in the area of the screen, and at least one boundary in the fourth direction in the area of the screen.

7A and 7B, the plurality of boundaries to which each of the plurality of external devices can be mapped has been described as constituting all the boundaries between the areas other than the screen area and the screen area, but the present invention is not limited thereto. Specifically, the plurality of boundaries to which each of the plurality of external devices can be mapped can configure only a part of the entire boundary between the screen area and the area other than the screen area.

For example, as shown in FIG. 7C, a plurality of boundaries 741, 742, 743, 744, 745, 746, 747, 748, 749 and 750, to which each of a plurality of external devices can be mapped, Direction in the screen region and a boundary in the " left " direction in the screen region, but does not constitute the boundary in the " up " direction in the screen region.

As another example, some of the boundaries in the " right " direction in the area of the screen may constitute boundaries where external devices may be mapped, but other portions of the boundaries in the & It may not constitute a boundary that can be formed.

8 is a diagram for explaining a plurality of directions in which an external device can be mapped according to an embodiment of the present invention.

When the pointer displayed on the screen moves out of the screen area according to the motion of the remote control device, all the directions in which the pointer can move out of the screen area may include a plurality of directions in which each of the plurality of external devices can be mapped have.

For example, the pointer may deviate in all directions within a 360 degree angle relative to a particular angle from the area of the screen.

8A, all directions in which the pointer can move out of the screen area may include a plurality of directions 811, 812, 813 and 814 in which each of a plurality of external devices can be mapped.

Here, a plurality of directions (811, 812, 813, and 814) in which each of the plurality of external devices can be mapped is a direction in which the pointer can move out of the screen area in the upward direction 811) (upward reference 0 degrees), rightward direction 812 (90 degrees upward reference) of all directions in which the pointer can move out of the screen area, downward direction of all directions in which the pointer can move out of the screen area 813 (180 degrees in the upward direction), and leftward direction 814 (270 degrees in the upward direction) among all directions in which the pointer may deviate from the screen area.

However, the number of directions in which an external device can be mapped is not limited. For example, as shown in FIG. 8B, a plurality of directions 821, 822, 823, 824, 824, 826, 827, and 828 to which an external device can be mapped can be configured in eight directions.

Further, the specific direction may correspond to an angle within a certain range. For example, an angle corresponding to the first direction 821 may be an angle between 337.5 degrees and 22.5 degrees, and an angle corresponding to the second direction 822 may be an angle between 22.5 degrees and 67.5 degrees.

In the present embodiment, the angles of the specific directions and the directions adjacent to the angles are all equal, but the present invention is not limited thereto. For example, the angle between the first direction and the second direction adjacent to the first direction may be 45 degrees, but the angle between the second direction and the third direction adjacent to the second direction may be 90 degrees.

8C is a diagram for explaining the boundary and direction in which an external device can be mapped according to the embodiment of the present invention.

The entire boundary between the area 810 of the screen and the area other than the area of the screen may include a plurality of boundaries 811, 812, 813 and 814. [

All directions in which the pointer can move out of the area 810 of the screen may be in a plurality of directions (0 degrees, 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees, 315 May also be included.

On the other hand, the external device is configured to display a plurality of directions (0 degrees, 45 degrees, 90 degrees) in which one of the plurality of boundaries 811, 812, 813, and 814 of the screen area 810 and the pointer are out of the screen area 810 , 135 degrees, 180 degrees, 225 degrees, 270 degrees, 315 degrees).

For example, the first external device may include a plurality of first external devices 811, 812, 813, and 814 at which first external device 811, 832, and 833 in the first direction 831. In this case,

As another example, the second external device may be configured such that at the first boundary 811 and the first boundary 811 of the plurality of boundaries 811, 812, 813, and 814, the pointer can escape the area 810 of the screen And may be mapped to the third direction 833 of the plurality of directions 831, 832, and 833.

As another example, the third external device may be configured such that at the second boundary 812 and the second boundary 812 of the plurality of boundaries 811, 812, 813, and 918, And may be mapped to the second direction 835 of the plurality of directions 834, 835, and 836.

On the other hand, as described above, an external device may not be mapped to a part of the entire boundary of the screen area 810.

On the other hand, the number of boundaries to which the external device can be mapped, the number of directions in which the external device can be mapped, or the number of boundaries and directions to which the external device can be mapped can be determined according to the user setting.

In addition, the length of the boundary to which the external device can be mapped, the angle of the direction in which the external device can be mapped, or the length and direction of the boundary to which the external device can be mapped can be determined according to the user setting.

As described above, the present invention provides various methods for mapping external devices, thereby providing an environment capable of mapping external devices so as to match the actual placement environment of external devices.

For example, since the number of areas to which an external device can be mapped can be changed, the user can set the mapping area flexibly according to the number of external devices.

Further, there is an advantage that the mapping area can be appropriately set according to the position of the external device.

For example, when there is a PC, a notebook, and a USB on the left side of the television and a Blu-ray player only on the right side of the television, the user sets three mapping areas at the left border of the area of the screen, Only one mapping area can be set on the right boundary. Also, by adjusting the length of the mapping area, it is possible to map a PC, a notebook, and a USB to each of a plurality of boundaries dividing the left boundary of the screen area into three, and map a Blu-ray player to the entire right boundary of the screen area It is possible.

When there is no external device on the upper side of the television, the user may not set the mapping area on the upper border of the area of the screen.

Referring again to FIG. 3, the method of operating the display device according to the embodiment of the present invention may include detecting (S610) a plurality of external devices communicating with the display device. This will be described in detail with reference to FIG.

9 is a view showing a display screen in a state where a plurality of external devices communicating with the display device are detected according to an embodiment of the present invention.

The controller 170 may sense a plurality of external devices communicating with the display device 100. [

Specifically, when a plurality of external devices are connected to the display device 100 through the external device interface 135 or a plurality of external devices communicate with the display device 100 through the communication unit 195, Can receive the identification information of each of the plurality of external devices from each of the plurality of external devices.

The control unit 170 also acquires information about each of a plurality of external devices communicating with the display device 100 based on the identification information received from each of the plurality of external devices, Information 910 can be displayed as shown in Fig.

The information 910 for each of the plurality of external devices may include at least one of a type of the external device and an icon corresponding to the external device. Specifically, the controller 170 can determine the type of the external device based on the identification information received from the external device, and display the type of the external device. In addition, when the type of the external device is determined, the controller 170 may display an icon corresponding to the external device.

In the present embodiment, the icon is an icon representing the type or type of the external device, but the present invention is not limited thereto. For example, the icon may be an icon representing the type of the content output from the external device, or an icon indicating how the content is output. For example, an icon corresponding to a Blu-ray player may include a movie poster or a videotape. As another example, the icon corresponding to the digital camera may include a photograph.

As described above, the present invention provides an environment in which a user can easily check a mapping area of an external device.

3, a method of operating a display device according to an exemplary embodiment of the present invention includes: inputting a user input for mapping at least one of angles and boundaries corresponding to a plurality of external devices to each of a plurality of detected external devices; And a step S630 of mapping and storing at least one of the angle and the boundary to each of the plurality of detected external devices based on the receiving step S620 and the user input.

A step (S620) of receiving a user input for mapping at least one of an angle and a boundary corresponding to each of the plurality of external devices to each of the plurality of detected external devices, and a step (S630) in which at least one of the angle and the boundary is mapped and stored will be described in detail with reference to FIG.

10 is a diagram for explaining a method of mapping a boundary corresponding to each of a plurality of external devices to each of a plurality of external devices according to an embodiment of the present invention.

The control unit 170 may receive a user input for selecting one of the plurality of external devices.

In FIG. 10A, it is assumed that the PC 1010 is selected by user input

On the other hand, the control unit 170 displays a plurality of images corresponding to a plurality of boundaries 1081, 1082, 1083, 1084, 1085, 1086, 1087, 1088, 1089, and 1090 on the screen of the display device 100, Areas 1051, 1502, 1503, 1504, 1505, 1506, 1507, 1508, 1509, 1560 can be displayed.

Meanwhile, the controller 170 may receive information on the motion of the remote control device 200 from the remote control device 200. Then, as shown in Fig. 10B, the controller 170 can move and display the pointer so as to correspond to the motion of the remote controller.

On the other hand, as the pointer moves after the PC 1010 is selected, the controller 170 can move and display the icon 1030 of the PC corresponding to the movement of the pointer.

On the other hand, when the pointer moves to the area 1059 corresponding to the ninth boundary 1089, the control unit 170 controls the PC to include a plurality of boundaries 1081, 1082, 1083, 1084, 1085, 1086, 1087, 1088, 1089, 1090 to the ninth boundary 1089 and store the mapped information in the storage unit 140.

In this case, the information on the ninth boundary 1089 stored in the storage unit 140 may be information on the coordinates corresponding to the ninth boundary 1089. For example, when the coordinates corresponding to the ninth boundary 1089 are (x, y) = (0, 540 to 1080), the controller 170 controls the PC to display coordinates 0 , 540 to 1080) can be mapped and stored.

10C, the controller 170 sets the area 1059 corresponding to the ninth boundary 1089 to which the external device is mapped to the other areas 1051, 1052, 1053, 1054, 1055 , 1056, 1057, 1058, 1060). For example, the control unit 170 determines that the area 1059 corresponding to the ninth boundary 1089 to which the PC is mapped is darker than the other areas 1051, 1052, 1053, 1054, 1055, 1056, 1057, 1058, Color display.

When the mapping is completed, the controller 170 displays an icon 1030 of the external device mapped to the ninth boundary 1089 in an area 1059 corresponding to the ninth boundary 1089 to which the external device is mapped can do.

On the other hand, in the present embodiment, the pointer is divided into regions 1051, 1502, 1503, 1504, 1505, 1506, 1506, and 1507 corresponding to the plurality of boundaries 1081, 1082, 1083, 1084, 1085, 1086, 1087, 1088, 1089, 1507, 1508, 1509, and 1560, the boundary is mapped to the external device. However, the present invention is not limited thereto.

For example, if the poster displayed on the screen passes through the boundary of any one of the plurality of boundaries 1081, 1082, 1083, 1084, 1085, 1086, 1087, 1088, 1089, 1090, The boundaries of the plurality of borders 1081, 1082, 1083, 1084, 1085, 1086, 1087, 1088, 1089, and 1090 through which the pointer passes may be mapped to an external device selected by the user and stored in the storage unit 140.

11 is a diagram for explaining a method of mapping a direction corresponding to each of a plurality of external devices to each of a plurality of external devices according to an embodiment of the present invention.

11A, it is assumed that the PC 1110 is selected by user input

On the other hand, the control unit 170 may display UIs 1151, 1152, 1153, 1154, 1155, 1156, 1157, and 1158 indicating a plurality of directions in which an external device can be mapped on the screen of the display device 100 .

Meanwhile, the controller 170 may receive information on the motion of the remote control device 200 from the remote control device 200. Then, as shown in Fig. 11B, the controller 170 can move and display the pointer so as to correspond to the motion of the remote controller.

On the other hand, as shown in Fig. 11C, if the pointer moves out of the screen area in the same direction as the UI 1156 indicating the sixth direction, the controller 170 controls the PC And stores the mapped directions in the storage unit 140.

In this case, the information on the sixth direction stored in the storage unit 140 may be information on an angle corresponding to the sixth direction. For example, when the angle? In the sixth direction is 225 degrees with respect to the upper direction of the screen, the controller 170 may map 225 degrees, which is the angle? Corresponding to the sixth direction, to the PC.

11D, when the mapping is completed, the controller 170 displays the UI 1156 indicating the sixth direction in which the external device is mapped to the UIs 1151, 1152, 1153, 1154, 1155, 1157, and 1158, respectively. For example, the control unit 170 can display the UI 1156 indicating the sixth direction in which the PC is mapped in a darker color than the UIs 1151, 1152, 1153, 1154, 1155, 1157, and 1158 indicating other directions have.

Meanwhile, when the mapping is completed, the controller 170 may display the icon 1130 of the external device mapped to the sixth direction together with the UI 1156 indicating the sixth direction in which the external device is mapped.

On the other hand, in the present embodiment, when a specific external device is selected and the pointer moves out of the screen area, the direction is mapped to the selected external device. However, the present invention is not limited to this, and a specific direction may be mapped to a specific external device when a specific external device is selected and the pointer moves in a certain direction (i.e., the pointer does not deviate from the screen area).

12 is a diagram for explaining a method of mapping boundaries and directions to an external device according to an embodiment of the present invention.

12A, it is assumed that the PC 1210 is selected by user input

On the other hand, the controller 170 displays on the screen of the display device 100 the areas 1250, 1260, 1270, and 1280 corresponding to a plurality of borders capable of mapping external devices and a plurality of directions 1252, 1253, 1261, 1262, 1263, 1271, 1272, 1273, 1281, 1282, 1283 indicating the UIs 1251, 1252,

The first UI 1251, the second UI 1252, and the third UI 1253 are areas corresponding to the boundaries located in the " up " It is a UI that indicates the direction to be mapped along with the border located in the " up "

Likewise, the second area 1260 corresponds to the border located in the " right " direction of the screen area, and the fourth UI 1261, the fifth UI 1262, In the " up " direction.

Meanwhile, the controller 170 may receive information on the motion of the remote control device 200 from the remote control device 200. Then, as shown in Fig. 12B, the controller 170 can move and display the pointer so as to correspond to the motion of the remote controller.

On the other hand, as the pointer moves after the PC 1210 is selected, the controller 170 can move and display the icon of the PC corresponding to the movement of the pointer.

On the other hand, as shown in Fig. 12C, when the pointer moves out of the screen through the boundary located in the " left " direction of the area of the screen and moves out of the area of the screen in the same direction as the seventh UI 1281 representing the seventh direction , The controller 170 may map the boundary and the seventh direction located in the " left " direction of the area of the screen to the PC and store the mapping in the storage unit 140. [

The information on the specific boundary and the information on the specific direction stored in the storage unit 140 may be information on the coordinates of the specific boundary and information on the angle corresponding to the specific direction, respectively.

For example, when the coordinates of the boundary in the " left " direction of the area of the screen is (x, y) = (0, 0 to 1080) and the angle in the seventh direction is 225 degrees with respect to the upper direction of the screen, The controller 170 may map and store the coordinates 225 of the boundary positioned in the " left " direction of the screen area (0, 0 to 1080) and the angle 225 corresponding to the seventh direction to the PC.

On the other hand, when the mapping is completed, as shown in FIG. 12D, the control unit 170 displays the UI 1281 indicating the "left" direction boundary and the seventh direction in which the external device is mapped so as to be distinguishable from other UIs .

When the mapping is completed, the control unit 170 displays a boundary in the left direction and a boundary in the left direction together with the UI 1281 indicating the boundary in the left direction and the seventh direction in which the external device is mapped, Lt; / RTI > icon 1230 of FIG.

External devices around the TV are generally located at fixed locations. Therefore, the user can map a specific external device to a boundary or direction corresponding to an area where a specific external device is located. Thus, the user can intuitively switch the external input by moving the pointer in the direction in which the actual external device is located when the external input is switched.

When the location where the external device is located is changed, by changing the mapping area accordingly, the user can intuitively switch the external input in the direction in which the actual external device is positioned when the external input is switched.

10 to 12, the mapping method of the external device according to the moving direction and the moving area of the pointer has been described, but the mapping method of the external device is not limited thereto. For example, when a specific external device is selected, the control unit 170 controls a plurality of boundaries capable of mapping a specific external device, a plurality of directions in which a specific external device can be mapped, The directions can be listed and displayed. If at least one of the specific boundary and the specific direction included in the list is selected by the user, the controller 170 may map at least one of the specific boundary and the specific direction to the specific external device and store the specific boundary in the storage unit 140 .

6, an operation method of a display apparatus according to an embodiment of the present invention may include displaying at least one of an angle and a boundary corresponding to each of the plurality of external apparatuses (S640).

This will be described in detail with reference to FIG.

13 to 15 are views for explaining a method of displaying at least one of boundaries and directions in which a plurality of external devices are mapped according to an embodiment of the present invention.

13 is a diagram showing a plurality of boundaries to which a plurality of external devices according to the embodiment of the present invention are mapped.

When an input for confirming the mapping state of each of the plurality of external devices is received, the controller 170 may display an area corresponding to the boundary where each of the plurality of external devices is mapped.

More specifically, the control unit 170 controls the display unit 140 to display a plurality of images corresponding to a plurality of boundaries 1354, 1355, 1356, 1357, 1358, 1359, and 1360 to which a plurality of external devices are mapped, A plurality of areas 1314, 1315, 1316, 1317, 1318, 1319, and 1320 can be displayed.

The controller 170 also includes a plurality of areas 1314, 1315, 1316, 1317, 1318, 1318, 1316, 1314, 1316, and 1314 corresponding to a plurality of boundaries 1354, 1355, 1356, 1357, 1358, 1359, 1360 to which a plurality of external devices are mapped, 1332, 1333, 1334, 1335, 1336 corresponding to each of a plurality of boundaries 1354, 1355, 1356, 1357, 1358, 1359, 1360 to which a plurality of external devices are mapped , 1337 can be displayed. Each of the plurality of icons 1331, 1332, 1333, 1334, 1335, 1336, and 1337 may be an icon representing each of the plurality of external devices.

For example, when the PC is mapped to the fourth boundary 1354, the controller 170 may display the fourth area 1314 corresponding to the fourth boundary 1354. [ In addition, the controller 170 may display an icon 1331 indicating a PC with a fourth area 1314 corresponding to the fourth boundary 1354.

On the other hand, in FIG. 13, when an input for confirming the boundary where each of the plurality of external devices is mapped is displayed, an area corresponding to the boundary where each of the plurality of external devices is mapped is displayed, but the present invention is not limited thereto.

Specifically, the controller 170 controls the areas 1311, 1312, 1313, and 1360 corresponding to the plurality of boundaries 1351, 1352, 1353, 1354, 1355, 1356, 1357, 1358, 1359, 1312, 1313, 1314, 1315, 1316, 1317, 1318, 1319, 1320). That is, the control unit 170 determines whether or not the boundary between the plurality of external apparatuses to which the external apparatuses are mapped, out of the plurality of boundaries 1351, 1352, 1353, 1354, 1355, 1356, 1357, 1358, 1359, 1315, 1316, 1317, 1318, 1319, and 1320 corresponding to the respective regions 1351, 1354, 1355, 1356, 1357, 1358, 1359, 1360, and boundaries 1351, 1352, It is possible to display all of the areas 1311, 1312, and 1313 corresponding to the respective areas.

The controller 180 controls the areas 1314, 1315, 1316, 1317, 1318, 1319, and 1320 corresponding to the boundaries 1354, 1355, 1356, 1357, 1358, 1359, Areas 1311, 1312, and 1313 corresponding to the boundaries 1351, 1352, and 1353, to which the actual external device is not mapped, can be displayed so as to be distinguishable from each other. For example, the control unit 170 may generate the area 1314, 1315, 1316, 1317, 1318, 1319, 1320 corresponding to each of the boundaries 1354, 1355, 1356, 1357, 1358, 1359, Can be displayed in a darker color than the areas 1311, 1312, and 1313 corresponding to the boundaries 1351, 1352, and 1353 to which no actual external device is mapped.

14 is a diagram showing a plurality of directions in which a plurality of external devices according to the embodiment of the present invention are mapped.

When an input for confirming the mapping state of each of the plurality of external devices is received, the controller 170 displays UIs 1412, 1413, 1414, 1415, 1416, 1417, 1418 < / RTI >

In addition, the control unit 170 may display UIs 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to a plurality of directions in which the plurality of external devices are mapped, (1431, 1432, 1433, 1434, 1435, 1436, 1437). The UIs 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to the plurality of directions in which the plurality of external devices are mapped include a plurality of icons 1431, 1432, 1433, 1434, 1435, 1436, 1437). Each of the plurality of icons 1331, 1332, 1333, 1334, 1335, 1336, and 1337 may be an icon representing each of the plurality of external devices.

For example, when the USB is mapped to the eighth direction, the controller 170 may display the UI 1418 corresponding to the eighth direction. In addition, the controller 170 may display the icon 1437 indicating the USB mapped in the eighth direction so as to correspond to the UI 1418 corresponding to the eighth direction.

14, the direction in which each of the plurality of external devices is mapped is displayed, but the present invention is not limited thereto.

Specifically, the control unit 170 can display UIs 1411, 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to a plurality of directions in which a plurality of external devices can be mapped. That is, the control unit 170 controls the UIs 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to the directions in which the external devices are mapped among the plurality of directions in which each of the plurality of external devices can be mapped, It is possible to display all the UIs 1411 corresponding to the directions in which the device is not mapped.

Meanwhile, the controller 170 controls the UIs 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to the direction in which the actual external device is mapped and the UI 1411 corresponding to the direction in which the actual external device is not mapped So that they can be distinguished from each other. For example, the controller 170 controls the UIs 1412, 1413, 1414, 1415, 1416, 1417, and 1418 corresponding to the direction in which the actual external device is mapped to the UI 1411 ) Can be displayed with a darker color.

15 is a diagram showing a plurality of boundaries and directions in which a plurality of external apparatuses according to an embodiment of the present invention are mapped.

When an input for confirming the mapping state of each of the plurality of external devices is received, the controller 170 can display an area and a direction corresponding to a boundary where each of the plurality of external devices is mapped.

More specifically, the control unit 170 includes a plurality of areas 1520, 1530, and 1570 corresponding to a plurality of boundaries 1572, 1573, and 1574 to which a plurality of external devices are mapped, 1540, 1532, 1533, 1541, 1543 indicating a plurality of directions in which a plurality of external devices are mapped.

The seventh UI 1531, the eighth UI 1532 and the ninth UI 1533 among the UIs 1522, 1523, 1531, 1532, 1533, 1541, and 1543 indicating a plurality of directions in which the plurality of external devices are mapped , And a third boundary 1573. The UI is a UI representing three directions mapped with the third boundary 1573. [

As another example, the tenth UI 1541 and the twelfth UI 1543 out of the UIs 1522, 1523, 1531, 1532, 1533, 1541, and 1543 indicating a plurality of directions in which a plurality of external devices are mapped, 4 < / RTI >

For example, the notebook is mapped in the same direction as the second border 1572 and the fifth UI 1522, and the USB is mapped in the same direction as the fourth border 1574 and the twelfth UI 1543.

In addition, the control unit 170 may display an icon corresponding to each of a plurality of external devices, together with a UI indicating a border and direction in which a plurality of external devices are mapped.

For example, the control unit 170 displays an icon 1557 indicating an external device mapped to the fourth boundary 1574 and the twelfth direction together with the UI 1543 indicating the fourth boundary 1574 and the twelfth direction Can be displayed.

On the other hand, in FIG. 15, when an input for confirming the boundaries to which the plurality of external devices are mapped is displayed, the boundaries and directions in which the plurality of external devices are mapped are displayed, but the present invention is not limited thereto.

More specifically, the control unit 170 includes a plurality of areas (1571, 1572, 1573, and 1574) corresponding to a plurality of boundaries 1571, 1572, 1573, and 1574 to which a plurality of external devices can be mapped, 1512, 1513, 1521, 1522, 1523, 1531, 1532, 1533, 1541, 1542, 1543 indicating a plurality of directions in which a plurality of external devices can be mapped Can be displayed.

The controller 170 controls the areas 1520, 1530 and 1540 corresponding to the boundaries 1572, 1573 and 1574 to which the external device is mapped and the UIs 1522, 1523, 1531, 1532, 1533, 1541 and 1543 corresponding to the regions 1511 corresponding to the boundaries 1571 to which the actual external devices are not mapped and the UIs 1511, 1512, 1513 and 1521 , &Lt; / RTI > 1542).

13 to 15, a plurality of icons corresponding to a plurality of external devices are displayed. However, the present invention is not limited to this, and the types of each of the plurality of external devices can be displayed.

As described above, the present invention provides an environment in which an area corresponding to an external device can be easily identified. That is, the user can change the mapping area by checking the area (boundary, or direction, or boundary and direction) corresponding to the external device, and the user can easily switch the input to the desired external device.

Referring back to FIG. 6, the method of operating the display device according to the embodiment of the present invention may include displaying the pointer on the screen (S650) and receiving the information about the motion of the remote control device (S660) have.

The remote control device 200 may receive an input for displaying a pointer and the control unit 180 may receive a command for displaying the pointer from the remote control device 200 through the user input interface unit 150 have.

In addition, the control unit 170 may control the display unit 180 to display a pointer when an instruction to display the pointer is received.

The remote control device 200 can sense the motion of the remote control device 200 and can transmit information about the motion of the sensed remote control device 200 to the display device 100.

Meanwhile, the operation method of the display apparatus according to the embodiment of the present invention may include a step (S670) of obtaining the coordinates of the pointer corresponding to the motion of the remote control apparatus, based on the information of the motion of the remote control apparatus have.

This will be described in detail with reference to FIG.

16 is a diagram for explaining a method of obtaining coordinates of a pointer corresponding to a motion of a remote control apparatus according to an embodiment of the present invention.

The coordinates of the pointer corresponding to the motion of the remote control device include the coordinates for the area 1610 on the screen of the display device 100 and the coordinates for the virtual area 1620 other than the screen of the display device 100 .

Specifically, when the pointer 1630 is located in the area 1610 on the screen of the display device 100, the controller 170 controls the remote controller 200 based on the information about the motion of the remote controller 200, The coordinates of the pointer 1630 moving in correspondence with the movement of the pointer 1630 can be calculated. Further, the control unit 170 can display the pointer 1630 on the screen based on the coordinates of the calculated pointer 1630. [

Meanwhile, the pointer 1640 may be located in an area 1620 other than the screen of the display device 100. Here, the pointer 1640 may be a virtual pointer rather than a pointer displayed on the screen.

In this case, the controller 170 can acquire the virtual coordinates of the virtual pointer 1640 moving in accordance with the motion of the remote controller 200, based on the information about the motion of the remote controller 200 .

On the other hand, based on the coordinates of the pointer, the controller 170 can determine whether the pointer 1630 is out of the area 1610 on the screen.

For example, when the coordinates of the pointer moving in correspondence with the movement of the remote control device 200 are out of the coordinates of the area 1610 on the screen, the controller 170 determines that the pointer 1630 is positioned on the screen area 1610 It can be judged to be departing.

As another example, when the coordinates of the pointer moving in correspondence with the motion of the remote control device 200 are changed from the coordinates of the area 1610 on the screen to the virtual coordinates of the area 1620 other than the screen, The controller 170 can determine that the pointer 1630 is out of the area 1610 on the screen.

Referring back to FIG. 6, the method of operating the display device according to the embodiment of the present invention includes switching the external input (S680) when the pointer is out of the area corresponding to the screen, based on the coordinates of the obtained pointer . This will be described in detail with reference to FIGS. 17 to 27. FIG.

17 to 18 are diagrams for explaining a method of switching an input provided to a display device to an external input when a pointer moves out of a screen area according to an embodiment of the present invention.

The input provided to the display device may be a USB, a PC, an external hard disk, a Blu-ray player, a set top box, a digital camera, a notebook, a game machine, a camcorder, a smart phone, a tablet PC, A DVD player, a video player, or the like.

The input provided to the display device may be broadcast content received from the broadcast provider, received through the tuner 131, or content received from the content provider and received through the network interface 133.

The controller 170 may output an image using an input provided to the display device. For example, when an input is provided from a set-top box (that is, when a broadcast image is output from a set-top box), the controller 170 may output the broadcast image using the input provided from the set- For example, when an input is provided from the notebook to the display device 100, the control unit 170 outputs an image on the screen of the notebook using an input (for example, an image on the screen of the notebook) can do. In another example, when an input is provided from the USB to the display device 100, the control unit 170 uses the input provided from the USB (for example, the content stored in the USB) Can be output.

The "external input" described in the present specification can be used in various applications such as a USB, a PC, an external hard disk, a Blu-ray player, a set top box, a digital camera, a notebook, a game machine, a camcorder, A content input through a tuner 131, and a content input through a network interface unit, as well as an input provided from an external device such as a player, an audio player, a DVD player, and a video player.

Therefore, not only can the external input be switched to the input provided by one of the external devices while the broadcast contents inputted through the tuner 131 are being displayed, but also an image corresponding to the input provided by one of the external devices The external input may be switched to broadcast contents received through the tuner 131 in a state in which it is being displayed.

On the other hand, in Fig. 17 to Fig. 18, a USB is displayed on the first border 1711 of the screen area, a notebook is displayed on the second border 1712 of the screen area, And the PC is mapped to the fourth border 1714 of the area of the screen.

If the pointer is out of the screen area, the controller 170 may switch the input provided to the display device 100 to an external input. Specifically, when the pointer moves out of the screen area based on the coordinates of the pointer, the controller 170 can switch the input used for outputting the image to the display device 100 to the external input.

That is, when the pointer displayed on the screen moves from the screen area to the area outside the screen (i.e., the virtual coordinate area), the controller 170 can switch the input provided to the display device to the external input.

In this case, the control unit 170 controls the input provided to the display device so that the pointer 1720 out of the plurality of boundaries 1711, 1712, 1713, and 1714 of the area of the screen is located at a point 1721 It is possible to switch to an input provided from an external device corresponding to the specific border 1711. [

17A, when the pointer 1720 is out of the screen area at a specific point 1721 of the first border 1711, the control unit 170 controls the display unit 1720 It is possible to switch the input to an input provided by the USB which is an external device corresponding to the first boundary 1711. [

On the other hand, when the input provided to the display device is converted to the external input, the controller 170 can display the screen converted to the external input.

Specifically, when the input provided to the display device is switched to an input provided from a specific external device among a plurality of external devices, the controller 170 can display an image in a state where the input is switched to a specific external device.

For example, in FIG. 17A, images of broadcast contents received from the broadcast provider and received through the tuner 131 are displayed. 17B, when the input provided to the display device is switched to the input provided from the USB, the controller 170 displays the image provided in the state in which the input provided to the display device is switched to the input provided from the USB 1750 can be displayed.

In addition, when the input provided to the display device is switched to an input provided from the USB, the control unit 170 can receive the stored contents from the USB and control the display unit 180 to display images of the received contents have.

As another example, FIG. 18A shows a broadcast content received from a broadcast provider and received through a tuner 131, and the controller 170 displays an image of broadcast content.

On the other hand, when the pointer 1820 deviates from the screen area at a specific point 1821 of the fourth boundary 1814, the control unit 170 controls the input provided to the display apparatus 100 to correspond to the fourth boundary 1814 To an input provided from a PC as an external device.

Meanwhile, when the input provided to the display device is switched to the external input, the controller 170 can display an image received from the external input. Specifically, when the input provided to the display device 100 is switched to an input provided by a specific external device, the controller 170 can receive the image from a specific external device. The control unit 170 can display the received image.

For example, when the external input is switched to the input provided from the PC, the control unit 170 receives the image from the PC and displays the image received from the PC, as shown in FIG. 18B.

19 is a diagram for explaining a method of switching to external input when a plurality of external devices are mapped to a plurality of boundaries of an area of a screen.

According to Fig. 19, a digital camera is mapped to the first boundary 1930 of the plurality of boundaries of the screen region and a second boundary 1940 of the screen.

On the other hand, when the pointer 1910 moves out of the screen region through the first boundary 1930, the controller 170 can switch the input to the input provided by the external device corresponding to the first boundary 1930 have.

On the other hand, the pointer 1910 can deviate the screen region in various directions. That is, the pointer 1910 may be out of the first direction 1921, the second direction 1922, or the third direction 1923. However, in the case where the pointer 1910 deviates from the first direction 1921, deviates in the second direction 1922, and deviates in the third direction 1923, (1930). &Lt; / RTI >

Accordingly, when the pointer 1910 deviates from the first direction 1921, deviates from the second direction 1922, and deviates from the third direction 1923, the controller 170 controls the display device 100 to the input provided by the notebook, which is an external device corresponding to the first boundary 1930. [

On the other hand, when the pointer 1910 deviates from the area of the screen in the fourth direction 1924, the pointer 1910 deviates from the area of the screen through the second boundary 1940.

When the pointer 1910 moves out of the screen area in the fourth direction 1924, the controller 170 controls the input provided to the display device 100 to be a digital camera As shown in Fig.

20 is a diagram for explaining a method of switching to an external input when each of a plurality of external devices is mapped in a plurality of directions in which the pointer is out of the screen area.

20, PC is mapped in the seventh direction 2060 among the plurality of directions in which the pointer is out of the screen area, USB in the sixth direction 2050 out of the plurality of directions in which the pointer is out of the screen area.

On the other hand, when the pointer 1910 moves out of the screen area in the seventh direction, the controller 170 switches the input provided to the display device 100 to an input provided from the external device USB corresponding to the seventh direction .

For example, when the first pointer 2010 is out of the area of the screen in the seventh direction 2032, the controller 170 controls the input provided to the display device 100 to correspond to the outside It is possible to switch to an input provided from the USB which is a device.

As another example, when the second pointer 2020 is out of the screen area in the seventh direction 2031, the controller 170 controls the input provided to the display device 100 to correspond to the seventh direction 2060 It is possible to switch to an input provided from an external device USB.

If the first pointer 2010 is out of the screen area in the sixth direction 2033, the controller 170 controls the input provided to the display device 100 to be an external device corresponding to the sixth direction 2050 It is possible to switch to an input provided from a PC.

That is, in the embodiment of Fig. 20, the external input can be switched only in the direction in which the pointer deviates from the screen area, regardless of the boundary at the point where the pointer leaves the screen area.

21 is a diagram for explaining a method of switching external inputs when a plurality of external devices are mapped to a plurality of boundaries and directions of an area of a screen.

According to Fig. 21, in the second boundary 2150 of the plurality of boundaries and the fifth direction 2152 of the plurality of directions, the notebook is divided into the second boundary 2150 of the plurality of boundaries and the sixth boundary 2153 of the plurality of directions , A digital camera has a set-top box in a third boundary 2160 of a plurality of boundaries and a seventh direction 2161 of the plurality of directions, a third boundary 2160 of a plurality of boundaries, A Blu-ray player is installed in the first border 2162, the third border 2160 of the plurality of boundaries, and the ninth direction 2162 of the plurality of directions, the external hard disk, the fourth boundary 2170 of the plurality of boundaries, The USB is mapped in the tenth direction 2171 to the fourth boundary 2170 of the plurality of boundaries and the twelve directions 2172 out of the plurality of directions.

On the other hand, if the pointer passes the specific boundary of the plurality of boundaries of the screen region and moves out of the screen region, and the pointer moves out of the screen region in a specific direction, the control unit 170 displays the input provided to the display apparatus 100 It is possible to switch to an input provided from an external device corresponding to the specific boundary and the specific direction.

For example, when the first pointer 2110 passes the third boundary 2160 and moves out of the screen area, and the first pointer 2110 moves out of the screen area in the eighth direction 2111, the controller 170 May switch the input provided to the display device 100 to an input provided by a Blu-ray player which is an external device corresponding to the third border 2161 and the eighth direction 2162. [

As another example, when the first pointer 2110 passes the third boundary 2160 and moves out of the screen area, and the first pointer 2110 moves out of the screen area in the ninth direction 2112, 170 may switch the input provided to the display device 100 to an input provided from an external hard device corresponding to the third boundary 2161 and the ninth direction 2163.

As another example, if the second pointer 2120 passes the fourth boundary 2170 and moves out of the screen area, and the second pointer 2120 moves out of the screen area in the tenth direction 2121, 170 may switch the input provided to the display device 100 to an input provided by a PC which is an external device corresponding to the fourth boundary 2170 and the tenth direction 2171. [

As another example, if the second pointer 2120 passes the fourth boundary 2170 and moves out of the screen area, and the second pointer 2120 moves out of the screen area in the twelfth direction 2122, 170 may switch the input provided to the display device 100 to an input provided from USB which is an external device corresponding to the fourth boundary 2170 and the twelfth direction 2172. [

On the other hand, the third pointer 2130 passes the upper boundary of the area of the screen and leaves the area of the screen, but no external device is mapped to the upper boundary of the area of the screen. Accordingly, even if the third pointer 2130 passes through the upper boundary of the area of the screen and deviates to a plurality of directions 2131, 2132, and 2133, the controller 170 does not switch the input provided to the display device 100 .

On the other hand, the fourth pointer 2140 passes through the second boundary 2150 and moves out of the screen area, and out of the screen area in the fourth direction 2141. Meanwhile, the notebook computer and the digital camera are mapped to the second boundary 2150, but the direction in which the pointer is out of the screen area is different from the direction in which the notebook and the digital camera are mapped. Accordingly, the control unit 170 may not switch the input provided to the display device 100. [

On the other hand, when there is no external device whose pointer is out of the screen area or the pointer is out of the screen, the controller 170 displays a notification indicating that there is no external device corresponding to an out- Can be output.

22 to 24 are diagrams for explaining various methods for determining whether a pointer is out of a screen area according to an embodiment of the present invention.

22 is a diagram for explaining a method for determining that a pointer is out of a screen area when a user performs a shaking operation on a remote controller according to an embodiment of the present invention.

The control unit 170 can acquire the coordinates of the pointer based on the motion of the remote control device, and can determine whether the pointer is out of the area of the screen.

On the other hand, when the pointer 2210 moves to correspond to the shaking motion of the remote control device with reference to the boundary of the screen area, the controller 170 can determine that the pointer is out of the screen area.

Specifically, as shown in FIG. 22, the first movement 2221 of the pointer 2210 causes the pointer to move from the area on the screen to the virtual area outside the screen, the second movement 2222 of the pointer 2210, When the pointer moves from the virtual area outside the screen to the area on the screen and the pointer moves back to the virtual area outside the screen on the screen due to the third movement 2223 of the pointer 2210, ) Can determine that the pointer is out of the screen area.

23 is a diagram for explaining a method for determining whether a pointer moves out of a screen area according to a moving distance of a pointer according to an embodiment of the present invention.

The control unit 170 can acquire the coordinates of the pointer based on the motion of the remote control device 200 and determine the moving distance in one movement of the pointer.

Specifically, when the user moves the remote control device 200 one time in the upward direction, the controller 170 moves the pointer one time in the upward direction based on the motion of the remote control device 200 and displays the pointer. In this case, the control unit 170 can determine the moving distance of the pointer once. Here, the moving distance of the pointer may include not only the distance that the pointer moved on the screen area but also the distance that the pointer moved the virtual area other than the screen.

On the other hand, if the moving distance of the pointer is a specific distance or more, the controller 170 can determine that the pointer is out of the screen area.

For example, when the specific distance is b distance and the pointer 2310 moves a distance shorter than the b distance as shown in FIG. 23A, the controller 170 determines that the pointer does not deviate from the screen area .

As another example, when the specific distance is b distance and the pointer 2310 moves a distance c that is longer than the distance b as shown in FIG. 23B, the controller 170 may determine that the pointer is out of the screen area have.

24 is a diagram for explaining a method for determining whether a pointer moves out of a screen area according to a moving speed of a pointer according to an embodiment of the present invention.

The controller 170 can obtain the moving speed of the pointer based on the distance the pointer moves and the moving time of the pointer in accordance with the movement of the remote control device 200. [

Here, the moving distance of the pointer may include not only the distance that the pointer moved on the screen area but also the distance that the pointer moved the virtual area other than the screen.

On the other hand, if the moving speed of the pointer is higher than the specific speed, the controller 170 can determine that the pointer is out of the screen area.

For example, as shown in FIG. 24A, when the pointer 2410 moves at a speed lower than a specific speed and moves out of the screen area, the controller 170 determines that the pointer 2410 does not deviate from the screen area .

As another example, if the pointer 2410 moves at a speed exceeding a specific speed and is out of the screen area as shown in FIG. 24B, the controller 170 determines that the pointer 2410 is out of the screen area .

Conventionally, in order to switch to an external input, a list of interfaces (for example, a USB terminal, a first HDMI terminal, etc.) capable of external input is confirmed by pressing an external input button, and external input is switched by selecting a specific interface.

However, the present invention can more intuitively determine an external device that a user wants to switch by displaying an external device capable of providing an external input in the form of an icon representing the external device or the type of the external device.

Also, unlike the conventional method of selecting a specific interface on a list by pressing a specific button and switching to an external input, the environment can be switched to an external input by a simple operation of moving the pointer out of the area of the screen.

In addition, since the present invention can map an external device to an area desired by the user, the input can be switched by moving the pointer to an area where the actual external device is located. Therefore, Environment.

25 is a diagram for explaining a display screen when an input provided to a display device is switched to an external input according to an embodiment of the present invention.

25A, when the pointer 2510 is positioned at the boundary 2521 of the area of the screen corresponding to the PC while the input (broadcast contents) provided from the broadcast provider and received through the tuner 131 is being displayed, The control unit 170 may switch the input provided to the display device 100 to an input provided from the PC.

On the other hand, when the input provided to the display device 100 is switched to the input provided from the PC, the control unit 170 can receive the input provided from the PC. That is, as shown in Fig. 25B, the image can be received from the PC and the received image can be displayed. In this case, the image received from the PC may be the same image as the image displayed on the screen of the PC.

When an input provided to the display device 100 is switched to an input provided from a specific external device, the controller 170 may display an icon indicating a specific external device in an area corresponding to a boundary to which a specific external device is mapped .

For example, when an input provided to the display device 100 is switched to an input provided from the PC, the controller 170 displays an icon 2530 indicating a PC in an area corresponding to the border 2521 to which the PC is mapped Can be displayed.

However, the present invention is not limited to this, and an icon 2530 representing a PC may be displayed in one area on the screen. For example, an icon 2530 representing a PC may be displayed in the upper right area 2540 on the screen so as not to disturb the user's viewing.

On the other hand, an icon representing an external device that provides input to the display device 100 may be periodically displayed. For example, the control unit 170 displays an icon 2530 indicating the PC when the input provided to the display device 100 is switched to an input provided from the PC, and stops displaying the icon 2530 indicating the PC The user can repeatedly display the icon 2530 indicating the PC at a predetermined time interval.

On the other hand, an icon representing an external device that provides input to the display device 100 may be displayed according to user input. For example, when a user input for identifying an external device providing input to the current display device is received, the control unit 170 may display an icon 2530 representing the PC in one area on the screen.

26 is a view for explaining an operation method of an external device when an input provided to a display device is switched to an external input according to an embodiment of the present invention.

26A, in a state in which the input (broadcast contents) received from the broadcast provider and received through the tuner 131 is displayed, the pointer 2610 is displayed on the boundary 2621 of the area of the screen corresponding to the PC, The control unit 170 may switch the input provided to the display device 100 to an input provided from the PC.

Also, as shown in Fig. 26B, the controller 170 can receive and display an image from the PC.

530, 540, 550, 560, and 570 are mapped to the boundary of the screen area or the direction in which the pointer is moved out of the screen, the plurality of external devices 520, 530, 540, 550, 560, 570 may be in a state in which the power is on, and some of them may be in a state in which the power is off.

On the other hand, when the pointer 2610 is out of the boundary of the area of the screen corresponding to the specific external device, and the power of the specific external device is off, the controller 170 transmits the power on command to the specific external device The input provided to the display device 100 can be switched to an input provided from a specific external device. Specifically, the control unit 170 determines whether communication with a specific external device is possible through the communication unit 173 or the external device interface unit 135. If the communication with the specific external device is impossible The control unit 170 can transmit a power-on command to a specific external device.

26A, when the pointer 2610 is out of the boundary 2621 of the area of the screen corresponding to the PC and the power of the PC 520 is OFF, Can transmit a power ON command to the PC via the external device interface unit 135 or the communication unit 173. [

On the other hand, when the power ON command is received from the display device 100, the control unit of the PC 520 can turn on the power of the PC 520 and provide the input to the display device 100.

In this case, the control unit 170 can output an image using the input provided from the PC 520.

Each of the plurality of external devices 520, 530, 540, 550, 560 and 570 may include optical output units 521, 531, 541, 551, 561 and 571. Here, each of the optical output units 521, 531, 541, 551, 561, 571 may include an LED.

On the other hand, when the input provided to the display device 100 is switched to an input provided from a specific external device, the controller 170 can transmit the optical output command to a specific external device. For example, when an input provided to the display device 100 is converted to a PC-provided input, the control unit 170 may transmit an optical output command to the PC.

On the other hand, when the optical output command is received from the display device 100, the control unit of the PC 520 can control the optical output unit 521 to output the optical signal.

Meanwhile, the control unit 170 may periodically transmit the optical output command to the specific external device, and the control unit of the specific external device may periodically output the optical signal.

In addition, when a user input for identifying an external device providing input to the display device is received, the controller 170 can transmit the optical output command to a specific external device.

In this embodiment, the optical output command is transmitted. However, the present invention is not limited to this. For example, in the case of the USB 510 having no separate control unit, the control unit 170 of the display device 100 can directly control the optical output unit 511 of the USB 510 to output the optical signal have.

As described above, the present invention enables a user to easily identify an external device providing an external input in a state of being switched to an external input.

27 is a flowchart illustrating a process of displaying a pointer, acquiring the coordinates of a pointer based on a motion of the remote control device, and switching to an external input when the pointer moves out of the screen area, according to an embodiment of the present invention FIG.

As shown in Fig. 27A, the remote control device 200 can receive an input to the specific button 210. Fig. The input to the specific button 210 may be a user input for displaying a pointer and confirming a mapping state of each of a plurality of external devices.

Meanwhile, the remote control device 200 can transmit a signal corresponding to the specific button 210 to the display device 100.

On the other hand, when a signal corresponding to the specific button 210 is received from the remote control device 200, the control unit 170 can display the pointer 2710 on the screen. In addition, when a signal corresponding to the specific button 210 is received from the remote control device 200, the controller 170 may display at least one of a boundary and a direction corresponding to each of the plurality of external devices.

27B, for example, the control unit 170 displays areas 2721, 2722, 2723, 2724, 2725, 2726, and 2727 corresponding to a plurality of boundaries to which a plurality of external devices are mapped .

The control unit 170 also displays a plurality of icons 2741, 2742, 2743, 2744, 2745, 2746, and 2747 each representing a plurality of external devices in an area 2721 corresponding to each of a plurality of boundaries to which a plurality of external devices are mapped , 2722, 2723, 2724, 2725, 2726, 2727).

On the other hand, in FIG. 27B, the area corresponding to the boundary where the plurality of external devices are mapped is displayed, but the present invention is not limited thereto.

Specifically, the control unit 180 can display the areas 2721, 2722, 2723, 2724, 2725, 2726, 2727, 2728, and 2729 corresponding to each of the plurality of boundaries to which each of the plurality of external devices can be mapped .

The control unit 170 controls the areas 2721, 2722, 2723, 2724, 2725, and 2726 corresponding to the respective borders to which the actual external device is mapped and the areas 2727, 2728, 2729 can be displayed so as to be distinguishable from each other.

27C is a diagram showing the movement of the pointer corresponding to the movement of the remote control device and the movement of the remote control device;

Here, the movement of the remote control device 200 may be a movement in a state in which an input to a specific button is maintained. Specifically, the user can move the remote control device 200 while keeping the input to the specific button 210 of the remote control device 200. [ In this case, the remote control device 200 can transmit information on the motion of the remote control device 200 to the display device 100 in a state where the input to the specific button 210 is held.

The control unit 170 of the display device 100 receives the information about the movement of the remote control device 200 in a state where the input to the specific button 210 is maintained, It is possible to determine whether or not the pointer is out of the area of the screen based on the information about the motion of the remote control device 200 in the state where the pointer is moved.

The control unit 170 of the display device 100 receives the information about the movement of the remote control device 200 while the input to the specific button 210 is maintained and receives the information about the movement of the remote control device 200 The coordinates of the pointer 2710 can be obtained based on information on the motion of the pointer 2710. [ If the coordinates of the pointer 2710 are out of the screen area, the controller 170 can switch the input provided to the display device 100 to an external input.

On the other hand, in the present embodiment, a case where each of a plurality of external devices is mapped to a plurality of boundaries of an area of a screen has been exemplified, but the present invention is not limited thereto. For example, the controller 170 may display a direction in which a pointer, which is mapped to each of a plurality of external devices, is out of the screen area. As another example, the controller 170 may display a boundary of a screen area where a plurality of external devices are mapped, and a direction in which a pointer is out of a screen area.

As described above, according to the present invention, external input can be switched to an external device by a simple operation. For example, a conventional method of switching to external input includes (1) selecting an external input button to display a list of external devices, (2) moving the remote control device, and (3) (1) the user presses the external input button to confirm the mapping area of the external device, (2) the remote control device is moved only when the external input button is pressed, and then the external input is switched So that a simpler operation environment can be provided. In addition, since the mapping area of the external device can be confirmed at the same time, the accuracy of input switching can be improved.

In the present embodiment, the operation in the state where the input to the specific button is held has been described, but the present invention is not limited thereto.

For example, when the first input is received, the pointer is displayed. When the pointer moves out of the screen, the pointer is switched to the input provided by the external device corresponding to the direction (or boundary, or boundary and direction) . &Lt; / RTI >

As another example, when the first input is received, the pointer is displayed. When the second input is received, an icon representing each of the plurality of external devices is displayed. When the pointer moves out of the screen, the pointer moves in the direction , Or a boundary and a direction) of the input signal.

As another example, when the first input is received, an icon representing each of the pointer and the plurality of external devices is displayed, and when the pointer moves outside the screen area in a specific direction (or a specific boundary, or a specific boundary and direction) The pointer can be implemented in such a manner that the input is switched to an input provided by an external device corresponding to a direction (or boundary, or boundary and direction) in which the pointer leaves the screen.

28 is a diagram for explaining a method of displaying an external device corresponding to a specific boundary so that the pointer can be distinguished when the pointer passes the specific boundary and is out of the screen area.

In the above-described embodiment, when the pointer moves out of the screen area, the input provided to the display device 100 is directly converted to the external input. However, in this embodiment, when the pointer is out of the screen area and a user input for switching to the external input is received, the input provided to the display device 100 is switched to the external input.

FIG. 28A shows a plurality of external devices 510, 520, 530, 540, 550, 560, and 570 mapped to the boundaries of the screen area of the display device 100. FIG. In this case, each of the plurality of external devices may include optical output units 511, 521, 531, 541, 551, 561, and 571.

On the other hand, when the pointer 2810 passes through a specific boundary among the boundaries of the screen area and is out of the screen area, the controller 170 can transmit the optical output command to the external device corresponding to the specific boundary. 28A, when the pointer 2810 passes through the boundary 2821 corresponding to the PC 520 and is out of the screen area, the controller 170 instructs the PC 520 to output the optical output command Lt; / RTI > In this case, the control unit of the PC 520 can control the optical output unit 521 of the PC 520 to output the optical signal.

As another example, when the pointer 2810 passes the boundary 2822 corresponding to the Blu-ray player 540 and is out of the screen area, the controller 170 controls the Blu- 540). &Lt; / RTI > In this case, the control unit of the Blu-ray player 540 can control the optical output unit 541 of the Blu-ray player 540 to output the optical signal.

On the other hand, if the user input is received while the pointer is out of the screen area, the controller 170 can switch the input to the input provided by the external device corresponding to the border of the pointer outside the screen area. For example, when the pointer 2810 passes the boundary 2822 corresponding to the Blu-ray player 540 and moves out of the screen area, the optical output section 541 of the Blu-ray player 540 outputs the optical signal The control unit 170 may switch the input provided to the display device 100 to an input provided by the Blu-ray player 540. In this case,

29 is a diagram for explaining a method for switching input again when an input provided to a display device is switched to an external input.

The controller 170 can switch the input provided to the display device again while the input provided to the display device is switched to the external input.

Specifically, the controller 170 may receive information on the second motion of the remote controller in a state where the input provided to the display device is switched to the external input.

Further, the control unit 170 can obtain the coordinates of the pointer moving according to the second movement of the remote control device, based on the information about the second movement of the remote control device.

The pointer moving in accordance with the second movement moves from the area outside the screen to the area of the screen based on the coordinates of the pointer moving in correspondence with the second movement of the remote control device, The input provided to the display device can be switched to the second external input and the image can be displayed using the second external input when the pointer moves from the area of the screen to the area outside the screen.

On the other hand, when the input provided to the display device is an input provided from a specific external device, the controller 170 can control the input provided to the display device to be switched to the basic input.

29, when a virtual pointer 2910 located outside the area of the screen moves according to the motion of the remote control device and moves into the area of the screen, the controller 170 controls the display device The provided input can be switched to the basic input.

In this case, the primary input may be an input provided from a broadcast provider, i.e., broadcast content.

For example, when the display device 100 displays broadcast content using an external input (broadcast content) received from the set-top box, the controller 170 displays a virtual pointer 2910 located outside the area of the screen, When the user moves according to the movement of the control device and moves into the area of the screen, the input provided to the display device can be switched to the input provided from the set-top box. When the input is switched, the controller 170 can display the image using the input (broadcast content) provided from the set-top box.

As another example, when the display device 100 displays broadcast content using the broadcast signal received through the tuner 131, the controller 170 may display a virtual pointer 2910 located outside the screen area, The broadcast content can be displayed using the broadcast signal received through the tuner 131 when the mobile terminal moves in accordance with the movement of the controller and moves into the area of the screen.

A virtual pointer 2910 located outside the area of the screen moves according to the motion of the remote control device and moves into the area of the screen. A virtual pointer 2910 moves to the outside of the screen In a case where the control unit 170 moves through the boundary corresponding to the device and moves into the area of the screen, the control unit 170 can switch the input provided to the display device to the basic input.

For example, the external input in Fig. 29 is an input provided in the PC. In this case, the pointer 2910 moves according to the movement of the remote controller 200 and moves to the area of the screen, and the pointer 2910 passes through the boundary corresponding to the PC currently providing input to the display device 100 And moved into the area of the screen. In this case, the controller 170 switches the input provided to the display device to the basic input, and displays the image using the basic input.

On the other hand, when the input provided to the display device is an input provided from a specific external device, the controller 170 may control the input provided to the display device to be switched to an input provided from an external device other than the specific external device .

For example, in FIG. 29, an input provided to the display device 100 is an input provided by a PC, and an image of the PC is displayed. On the other hand, the second pointer 2920 has moved from the area of the screen to the area outside the screen, and the second pointer 2920 has moved to the area outside the screen through the boundary corresponding to the USB among the boundaries of the area of the screen.

In this case, the control unit 170 can switch the input provided to the display device from the input provided from the PC to the input provided from the USB. The control unit 170 may display an image using an input provided by the USB.

On the other hand, a plurality of boundaries dividing all or a part of the entire border of the screen region may include a border 2943 corresponding to the broadcast content. On the other hand, the controller 170 may display a region 2950 corresponding to the border 2943 corresponding to the broadcast content on the screen.

On the other hand, when the third pointer 2930 moves from the area of the screen to the area outside the screen and the third pointer 2930 passes through the boundary 2943 corresponding to the broadcast content and moves from the area of the screen to the area outside the screen, The control unit 170 may convert the input provided to the display device 100 into broadcast contents provided from the broadcast provider and display the broadcast contents.

If the third pointer 2930 passes through the boundary 2943 corresponding to the broadcast content and moves from the area of the screen to the area outside the screen, the controller 170 uses the broadcast signal received through the tuner 131 The broadcast contents can be displayed. If the third pointer 2930 passes through the boundary 2943 corresponding to the broadcast content and moves from the area of the screen to the area outside the screen, the controller 170 controls the input of the input provided to the display device 100 To an input provided from a set top box connected to the display device. The control unit 170 can receive and display broadcast content from the set-top box.

30 is a diagram for explaining a new external device mapping method when a new external device is detected according to an embodiment of the present invention.

530, 540, 550, 560, and 570 exist in the vicinity of the display device 100 and a plurality of external devices 510, 520, 530, 540, 550, 560, and 570) are mapped to specific boundaries of the screen region (or specific directions in which the pointer goes out of the screen region, or specific boundaries of the screen region and specific directions in which the pointers deviate from the screen region) .

On the other hand, when the new external device 580 accesses the display device 100, the control unit 170 can detect the new external device 580 through the communication unit 173. In the present embodiment, the new external device 580 is a cellular phone and the controller 170 detects new external device 580 through wireless communication through the communication unit 173, but the present invention is not limited thereto. For example, when a new external device such as a camcorder is connected to the display device 100 through the connection terminal of the external device interface unit 135, the control unit 170 uses the identification information received from the camcorder, The device can be detected.

On the other hand, when a new external device 580 is detected, the controller 170 can display a notification indicating that a new external device has been detected and information 3010 on a new external device, as shown in FIG. 30B.

The control unit 170 includes a plurality of areas 3081, 3082, 3082, and 3080 corresponding to the plurality of boundaries 3071, 3072, 3073, 3074, 3075, 3076, 3077, 3078, 3079, 3083, 3084, 3085, 3086, 3087, 3088, 3089, 3090). Here, the plurality of boundaries 3071, 3072, 3073, 3074, 3075, 3076, 3077, 3078, 3079, 3080 to which the external device can be mapped may constitute the entire boundary of the area of the screen, Only some of the boundaries can be configured.

Meanwhile, the control unit 170 controls the boundary units 3074, 3075, 3076, 3077, 3078, 3079, 3080 to which the external apparatuses are mapped, out of the plurality of boundaries 3071, 3072, 3073, 3074, 3085, 3089, and 3090 corresponding to the regions 3074, 3076, 3077, 3078, 3079, and 3080 correspond to the boundaries 3071, 3072, and 3073 to which the external device is not mapped (3081, 3082, 3083), which are different from each other. For example, the control unit 170 may highlight the plurality of areas 3081, 3082, and 3083 corresponding to the boundaries 3071, 3072, and 3083 to which the external device is not mapped, A plurality of areas 3081, 3082 and 3083 corresponding to the plurality of areas 3071, 3072 and 3073 correspond to the plurality of areas (3074, 3075, 3076, 3077, 3078, 3079 and 3080) 3084, 3085, 3086, 3087, 3088, 3089, 3090).

On the other hand, the boundary at which the external device can be mapped can be corrected. Specifically, when an input for correcting a boundary where an external device can be mapped is received, the controller 170 corrects the number of the plurality of boundaries to which the external device can be mapped, It is possible to correct the length each of the boundaries occupies on the entire boundary.

For example, when a user input for adding one more number of boundaries to the left border of the screen area is received, as shown in FIG. 30C, the controller 170 displays an external device on the left border of the screen area, A new boundary 3092 can be added, and the length of the existing boundaries 3079 and 3080 can be changed.

The controller 170 may display the areas 3089 and 3090 corresponding to the existing boundaries 3079 and 3080 and the area 3091 corresponding to the newly added boundaries 3092.

30D, a user input for selecting a newly detected external device is received, and a boundary 3092 of one of the boundaries to which the external device is not mapped by the movement of the remote control device 200 When the pointer 3020 moves, the controller 170 can map and store the new external device 580 in the boundary 3092 where the pointer has moved.

30, a new external device is mapped to one of a plurality of boundaries of an area of a screen. However, the present invention is not limited to this. For example, a new external device may be mapped to one of a plurality of directions in which the pointer is outside the area of the screen, and the new external device may be one of a plurality of boundaries of the area of the screen and a plurality of directions Can be mapped to one.

As described above, the present invention is advantageous in that it can automatically detect a new external device and provide an area where mapping can be performed to the user.

In addition, the present invention provides an environment in which a user can flexibly change an area of a mapping, and provides an environment in which an external device can be mapped to match the arrangement of an actual external device.

31 is a view for explaining a method of operating a display device according to another embodiment of the present invention.

In the above embodiment, when the pointer moves from the area of the screen to the area outside the screen, the input provided to the display device is switched to the external input. However, the present invention is not limited to this, and may be implemented in such a manner that an input provided to a display device is switched to an external input when a pointer moves to a specific area on an area of a screen.

Specifically, the area on the screen may include a first area 3130 and a second area 3140 that are distinguished by a specific boundary 3110 in the screen.

Here, the specific border 3110 in the screen may correspond to the border of the area of the screen described in FIGS. 5 to 30.

That is, all or part of the specific boundary 3110 in the screen may include a plurality of boundaries to which an external device can be mapped, and each of the plurality of boundaries may be mapped to each of a plurality of external devices. In this case, the pointer 3120 moves from the first area 3130 to the second area 3140 in accordance with the motion of the remote control device 200, and the pointer 3120 passes through a specific point within the specific boundary 3110 The control unit 170 determines whether the pointer 3120 has been moved from the first area 3130 to the second area 3140 by inputting an external input You can switch. For example, when the pointer passes through the left boundary of the first area 3130 and moves to the second area 3140 and the PC is mapped to the left boundary of the first area 3130, The input provided to the display device 100 can be switched to the input provided by the PC.

As another example, if the pointer maps each of a plurality of external devices in a plurality of directions out of the specific boundary 3110 and the pointer 3120 moves from the first area 3130 to the second area 3130 in accordance with the movement of the remote control device 200, The control unit 170 can switch the external input to the input provided by the external device corresponding to the direction in which the pointer 3120 deviates from the specific boundary 3110. [

As another example, when an external device is mapped to a boundary and a direction at which the pointer deviates from the specific boundary 3110, the pointer 3120 is moved from the first area 3130 to the second area 3130 in accordance with the movement of the remote control device 200. [ The control unit 170 can switch the external input to the input provided by the external device corresponding to the boundary and direction in which the pointer 3120 is out of the specific boundary 3110. [

32 is a diagram for explaining an operation method in the case where one boundary corresponds to a plurality of external apparatuses.

In the above embodiments, one external device is mapped to one boundary. For example, in FIG. 31, only the PC is mapped to the left boundary of the first area 3130. [

However, the present invention is not limited to this, and a plurality of external devices may be mapped to one boundary.

32, when the area of the screen includes a first area 3250 and a second area 3260 that are distinguished by a specific boundary 3240 in the screen, the first area 3250 A USB, a PC, and a mobile phone may be mapped to the left border 3241 of the mobile terminal.

The pointer 3220 moves from the first area 3250 to the second area 3260 in accordance with the movement of the remote control device 200 and the pointer 3220 moves to the left boundary 3241 of the first area 3250 The control unit 170 can display a list 3230 of a plurality of external devices (USB, PC, mobile phone) mapped to the left border 3241 of the first area 3250.

When an input for selecting one of a plurality of external devices (USB, PC, mobile phone) is received, the control unit 170 switches the input provided from the external device selected by the user to the input provided to the display device, An image can be displayed using an input provided from an external device.

33 is a view for explaining a method of operating a display device according to another embodiment of the present invention.

33, USB, PC, and mobile phone are mapped to the left border of the first area. 32, the left boundary of the first area may include a boundary corresponding to USB, a boundary corresponding to the PC, and a boundary corresponding to the mobile phone.

32, the pointer 3220 moves from the first area 3250 to the second area 3260 in accordance with the movement of the remote control device 200, and the pointer 3220 moves in the first area 3250, As shown in FIG. 33, the control unit 170 controls the movement of the first region 3250 in the left boundary 3241 corresponding to each of the plurality of boundaries included in the left boundary 3241 of the first region 3250 It is possible to display a plurality of icons 3331, 3332, and 3333 representing a plurality of devices corresponding to the areas 3321, 3322, and 3323 and the plurality of boundaries, respectively.

On the other hand, as the remote control device 200 moves while the areas 3321, 3322, and 3323 corresponding to the plurality of boundaries and the plurality of icons 3331, 3332, and 3333 indicating a plurality of devices are displayed When the pointer 3310 moves to the area 3321 corresponding to the USB or moves to the icon 3310 indicating the USB and receives the user input, the controller 170 controls the input provided to the display device from the USB And the image can be displayed using the input provided from the USB.

34 is a diagram for explaining a mapping method of an external device according to another embodiment of the present invention.

According to Fig. 34A, the display device 100 is in communication with a plurality of external devices. Also, the control unit 170 can acquire the positions of a plurality of external devices.

Specifically, the controller 170 may display a list of a plurality of external devices capable of communicating with the display device 100.

On the other hand, when an input for selecting a specific external device among a plurality of external devices is received, the controller 170 may output a notification to direct the remote control device to a specific external device selected by the user.

When the user of the remote control device 200 directs the remote control device 200 to a specific external device in response to the notification that the remote control device 200 should be directed to a specific external device, 100) of the specific external device can be obtained.

For example, when a PC is selected from a plurality of external devices and the remote control device 200 is directed to the area 3410 where the PC is located, the control unit 170 controls the virtual pointer 3420 and determines that the PC is located on the left side of the display device based on the calculated coordinates of the virtual pointer 3240. [

In this case, the controller 170 may map the PC to the left border of the screen of the display device and store the map. 34B, when the input for confirming the mapping state of the external device is received, the controller 170 displays an area 3430 corresponding to the left boundary to which the PC is mapped and an icon 3440 indicating the PC, Lt; / RTI >

34, the display device determines the position of the external device based on the display device, and maps the external device to the boundary of the screen area located in the direction in which the external device is located.

However, the present invention is not limited to this, and it is possible to map the position of the external device and to switch the input provided by the external device to the input provided to the display device when the pointer moves from the area of the screen to the area where the external device is located Can also be implemented.

This will be described in detail with reference to FIG.

35 is a diagram for explaining a method of mapping the position of an external device and switching an input according to movement of a pointer according to another embodiment of the present invention.

34, when the user directs the remote controller 200 to a specific external device, the controller 170 can acquire information on the position of the specific external device based on the display device 100 . For example, when a PC is selected from among a plurality of external devices and the remote control device 200 faces an area where the PC is located, the controller 170 calculates coordinates of a virtual pointer corresponding to the motion of the remote control device , And obtain the coordinates of the area where the PC is located based on the coordinates of the calculated virtual pointer.

In FIG. 35A, the current broadcast content is being displayed, and the pointer 3510 is displayed.

On the other hand, as the remote control apparatus 200 moves, the coordinates of the pointer can be changed. That is, when the remote controller 200 moves from the area on the screen to the area outside the screen, the controller 170 can acquire the coordinates of the virtual pointer 3520 corresponding to the movement of the remote controller 200.

35B, the controller 170 can determine whether the coordinates of the virtual pointer 3520 and the coordinates of the area 3530 in which the PC 520 is located coincide with each other.

When the coordinates of the virtual pointer 3520 coincides with the coordinates of the area 3530 in which the PC 520 is located, the control unit 170 can transmit the optical output command to the PC 520. [ In this case, the control unit of the PC 520 receiving the optical output command can control the optical output unit 521 to output the optical signal.

On the other hand, when the user input is received in a state where the coordinates of the virtual pointer 3520 coincides with the coordinates of the area 3530 where the PC 520 is located, the control unit 170, as shown in Fig. 35C, The input provided to the apparatus 100 can be switched to the input provided from the PC and the image can be displayed using the input provided from the PC.

FIG. 36 is a flowchart illustrating an operation method of a display apparatus according to another embodiment of the present invention.

36, a method of operating a display device according to another embodiment of the present invention includes receiving (S3610) a first control signal including information on a motion of a remote control device from a remote control device (S3610) (S3620) switching the input provided to the display device to the external input when the pointer moving in response to the movement of the control device moves from the screen area of the display device to an area outside the screen, (S3630) receiving a first image from a first external device that provides an input to the display device and displaying the first image, receiving (S3640) a second control signal from the remote control device, A step (S3650) of transmitting an instruction to the first external device based on the second control signal, Receiving the second image from the device (S3660), and displaying the second image (S3670).

(S3610) a step of receiving from the remote control device a first control signal including information on the motion of the remote control device, a pointer moving in accordance with the motion of the remote control device, The method described with reference to FIGS. 2 to 35 may be similarly applied to the step S3620 of switching the input provided to the display device to the external input when moving from the display area to the area outside the screen, and a detailed description thereof will be omitted.

The operation method of the display apparatus according to another embodiment of the present invention is divided into three embodiments and each step described in FIG. 36 is described.

37 to 45 show an embodiment in which an external device is controlled by displaying a pointer corresponding to the remote control device on the display unit of the external device when the display unit is mounted on an external device that provides input to the display device 100 And FIGS. 46 to 47 illustrate an embodiment in which an external device is controlled when the display unit is not mounted on an external device that provides an input to the display device 100. FIG. 48 to 50 illustrate an embodiment in which an external device is controlled using an image displayed on the display device 100 when a display device is mounted on the external device.

37 to 45, that is, when a display unit is mounted on an external device that provides an input to the display device 100, a pointer corresponding to the remote control device is displayed on the display unit of the external device, An embodiment for controlling will be described first.

37 is a diagram for explaining a method of receiving and displaying an image from an external device that provides an input to a display device according to an embodiment of the present invention.

A method of operating a display device according to an exemplary embodiment of the present invention includes a step S3630 of receiving a first image from a first external device that provides an input to a display device in response to input switching and displaying a first image can do.

Specifically, when the pointer moves from the area of the screen to the area outside the screen, the external device whose pointer corresponds to the direction out of the area of the screen, or the external device whose pointer corresponds to the boundary outside the area of the screen, It is possible to switch the input to the input provided by the external device corresponding to the boundary and direction outside the area. If the external device is the first external device, the controller 170 controls the input provided to the display device 100 to be an input provided from the first external device 570 among a plurality of external devices communicating with the display device You can switch.

Here, it is assumed that the first external device 3700 is a notebook computer.

In this case, the controller 170 may receive the image from the first external device 570 and may control the display unit 180 to display the received image 3710.

Here, the image received from the first external device 570 may be the image 3760 displayed on the screen of the first external device 570. That is, the image 3710 displayed on the display device 100 and the image 3760 displayed on the first external device 570 may be the same image.

FIG. 38 is a diagram for explaining a method of displaying a pointer or another image together with an image received from an external device.

The control unit 170 may control the display unit 180 to display the pointer 3810 together with the image 3710 received from the first external device 570 as shown in FIG. Here, the pointer 3810 can move in response to the movement of the remote control device 200.

In addition, the controller 170 may display another image 3820 together with the image 3710 received from the first external device 570.

Here, the other image 3820 may be an image received from a server such as a web browser image as shown in FIG. 38A.

The other image 3820 may include all images such as broadcast contents received through the tuner 131, images received from other external devices, and OSD menus generated in the display device 100 have.

36, a method of operating a display device according to an embodiment of the present invention includes receiving (S3640) a second control signal from a remote control device, and generating a second control signal based on the second control signal, (S3650). &Lt; / RTI > This will be described in detail with reference to Figs. 39 and 40. Fig.

39A to 39D are diagrams for explaining a method of receiving a second control signal from a remote control device and transmitting a command to a first external device based on a second control signal according to an embodiment of the present invention.

According to Fig. 39A, the control unit 170 can receive the control signal from the remote control device 200. Fig. Here, the control signal received from the remote control device 200 may include information on the motion of the remote control device 200.

In this case, the controller 170 may display the pointer 3810 moving in response to the movement of the remote controller 200. [ For example, as shown in FIG. 39A, when the remote control device 200 moves in a state that the pointer 3810 is displayed, as shown in FIG. 39B, in response to the movement of the remote control device 200, ) Can be moved and displayed.

On the other hand, the controller 170 can determine whether the pointer moves from the area of the screen to the area outside the screen, based on the information of the motion of the remote control device 200. [

39C, when the pointer moves from the area of the screen to the area outside the screen, the controller 170 displays a pointer 3911 in the area 3910 corresponding to the screen of the first external device 570 Can be obtained. Here, the pointer 3911 when moving to an area outside the screen means a virtual pointer rather than a pointer displayed on the actual screen.

Then, the controller 170 can transmit the command to the first external device 570. [ The controller 170 may transmit the coordinates of the pointer 3911 in the area 3910 corresponding to the screen of the first external device 570 to the first external device 570. [ The control unit 170 also displays a pointer on the screen coordinates of the first external device 570 corresponding to the coordinates of the pointer 3911 on the area 3910 corresponding to the screen of the first external device 570 Command to the first external device 570.

On the other hand, when a command to display the pointer on the screen of the first external device 570 and a coordinate of the pointer 3911 in the area 3910 corresponding to the screen of the first external device 570 are received, The control unit of the external device 570 can display the pointer 3961 based on the coordinates of the pointer 3911 in the area 3910 corresponding to the screen of the first external device 570. [

The position of the pointer 3911 on the area 3910 corresponding to the screen of the first external device 570 and the position of the pointer 3961 on the screen of the first external device 570 may correspond to each other. For example, when the coordinates of the pointer 3911 on the area 3910 corresponding to the screen of the first external device 570 are (x, y) = (30, 270), the first external device 570 (X, y) = (30, 270) on the screen of the first external device 570 of the pointer 3961 to be displayed.

39D, when the pointer 3911 in the area 3910 corresponding to the screen of the first external device 570 moves, the control unit 170 of the display device 100 displays the first external The changed coordinates of the pointer 3911 in the area 3910 corresponding to the screen of the device 570 can be transmitted to the first external device 570. [

In this case, the first external device 570 can display the pointer 3961 at a position corresponding to the position of the pointer 3911 in the area 3910 corresponding to the screen of the first external device 570. [

For example, when the coordinates of the pointer 3911 on the area 3910 corresponding to the screen of the first external device 570 is (x, y) = (690, 270) (X, y) = (690, 270) on the screen of the first external device 570 of the pointer 3961 displayed on the display unit 570 may be the same.

Figs. 40A to 40E are diagrams for explaining areas corresponding to screens of a first external device, according to various embodiments of the present invention. Fig.

According to FIG. 40A, the area corresponding to the screen of the first external device 570 may be a region in which the pointer is out of the screen, the center of one side. The center of one side 4021 of the area 4020 corresponding to the screen of the first external device 570 is a pointer (e.g., 8310 may be a specific point 4010 that is out of the screen. The horizontal length of the area 4020 corresponding to the screen of the first external device 570 may be the same as the horizontal length of the screen of the first external device 570, The vertical length of the corresponding area 4020 may be the same as the vertical length of the screen of the first external device 570.

In this embodiment, one side 4021 of the area 4020 corresponding to the screen of the first external device 570 is in contact with the display device 100, but the present invention is not limited thereto. For example, the center of one side 4021 of the area 4020 corresponding to the screen of the first external device 570 is a direction in which the pointer 8310 extends horizontally from the specific point 4010 out of the screen to the ground It may be located at a point outside a certain distance.

According to FIG. 40B, the area corresponding to the screen of the first external device 570 may be formed at a position corresponding to the boundary where the first external device 570 is mapped. For example, when the first external device 570 corresponds to a boundary of a plurality of boundaries of the screen region (i.e., when the first external device 570 is mapped to the a boundary), the first external device The area 4020 corresponding to the screen of the display unit 570 may be located in a region outside the specific distance in the horizontal direction from the a boundary to the ground. The area 4020 corresponding to the screen of the first external device 570 is not limited to one of the areas 4020 corresponding to the screen of the first external device 570, The side 4021 may be formed so as to be in contact with the a boundary.

40C, when the first external device 570 corresponds to a specific direction among a plurality of directions in which the pointer is out of the screen area (i.e., when the first external device 570 is mapped to a specific direction) The area corresponding to the screen of the first external device 570 may be located in a specific direction from the display device 100. [ For example, when the first external device 570 is mapped in the b direction among a plurality of directions in which the pointer is out of the screen area, the area 4020 corresponding to the screen of the first external device 570 is displayed on the display device 100 in the direction b.

40D, when the first external device 570 corresponds to a specific direction out of a plurality of directions in which a specific boundary and a pointer out of the plurality of boundaries of the screen correspond to a specific direction (that is, And in a specific direction), the area corresponding to the screen of the first external device 570 may be located in a specific direction at a specific boundary. For example, when the first external device 570 is mapped to the c boundary and the d direction, the area 4020 corresponding to the screen of the first external device 570 corresponds to the position corresponding to the c boundary and the direction d As shown in Fig.

On the other hand, in FIG. 34, a method of acquiring the coordinates at which a specific external device is located by directing the remote control device 200 to a specific external device has been described.

In this case, as shown in FIG. 40E, the area corresponding to the screen of the first external device 570 may be an area centered on the coordinate where the first external device 570 is located.

For example, when the pointer of the remote control device 200 is directed to a specific point 4051 to acquire the coordinate at which the specific external device is located, the area 4020 corresponding to the screen of the first external device 570 is specified And may be an area centered on the point 4051. [

40A to 40E, an area corresponding to the screen of the first external device may be formed in an arbitrary area out of the screen of the display device 100. [

40A to 40E, the size of the area corresponding to the screen of the first external device 570 may be the same as the size of the screen of the first external device 570. [

Specifically, the controller 170 can receive information on the size of the screen of the first external device 570 from the first external device 570.

On the basis of the information about the size of the screen of the first external device 570, the controller 170 controls the display of the first external device 570 in the same size (i.e., the same width and the same length) 1 An area corresponding to the screen of the external device 570 can be set.

Meanwhile, the size of the area corresponding to the screen of the first external device 570 is the same as the size of the screen of the first external device 570, but the present invention is not limited thereto. This will be described in detail with reference to FIG.

41 is a diagram for explaining a method of converting an area and a coordinate corresponding to a screen of the first external device.

The size of the area corresponding to the screen of the first external device 570 may be different from the size of the screen of the first external device 570. [ For example, as shown in FIG. 41, the size of the area 4020 corresponding to the screen of the first external device 570 may be the same as the size of the screen of the display device 100.

On the other hand, the controller 170 can receive information on the size of the screen of the first external device 570 from the first external device 570.

More specifically, when the display device 100 and the first external device 570 are connected, the controller 170 can receive information on the size of the screen of the first external device 570.

On the other hand, the controller 170 determines the coordinates of the pointer in the area 4020 corresponding to the screen of the first external device 570 on the basis of information about the screen size of the first external device 570, The coordinates of the pointer on the screen of the display unit 570 can be converted.

41, when the size of the area 4020 corresponding to the screen of the first external device 570 is equal to the size of the screen of the display device 100, the controller 170 controls the display device The coordinates of the pointer in the area 4020 corresponding to the screen of the first external device 570 are stored in the first external device 570 based on the screen size of the first external device 570 and the size of the screen of the first external device 570. [ ) To the coordinates of the pointer on the screen.

For example, when the horizontal length of the screen of the display device 100 is three times the horizontal length of the screen of the first external device 570 and the vertical length of the screen of the display device 100 is the length of the screen of the first external device 570 It is assumed that the vertical length of the screen is 2.5 times.

In this case, when the coordinates of the pointer 4110 in the area 4020 corresponding to the screen of the first external device 570 is (x, y) = (90, 540) The x coordinate in the area 4020 corresponding to the screen of the first external device 570 is set to the first external device 570 using the ratio of the screen length of the screen of the first external device 570 and the screen length of the screen of the first external device 570. [ Coordinates of the screen of the device 570 and may be converted into the x coordinate of the first external device 570 using the ratio of the vertical length of the screen of the first display device 100 and the vertical length of the screen of the first external device 570. [ The y coordinate in the area 4020 corresponding to the screen of the first external device 570 can be converted into the y coordinate in the screen of the first external device 570. [

Accordingly, the controller 170 can acquire the converted coordinates (x, y) = (90, 540), transmit the converted coordinates to the first external device 570, and transmit the converted coordinates to the first external The device 570 may display the pointer 4120 at a point corresponding to the transformed coordinates.

When the pointer 4110 in the area 4020 corresponding to the screen of the first external device 570 moves and the coordinate of the new pointer 4115 is (x, y) = (960, 270) The control unit 170 may acquire the converted coordinates x and y = 320 and 108 and transmit the coordinates to the first external device 570. The first external device 570 may transmit the coordinates A new pointer 4125 can be displayed.

In the present embodiment, coordinates are converted based on the size of the screen of the display device 100 and the size of the screen of the first external device 570, but the present invention is not limited thereto.

Specifically, when the display device 100 and the first external device 570 are connected, the controller 170 receives information on the resolution of the display portion of the first external device 570 from the first external device 570 .

Upon receiving the image from the first external device 570, the controller 170 acquires information on the resolution of the first external device 570 based on the resolution of the image received from the first external device 570 can do.

In this case, based on the resolution of the display unit 180 of the display device 100 and the resolution of the display unit of the first external device 570, the controller 170 controls the area corresponding to the screen of the first external device 570 The coordinates of the pointer in the first external device 570 can be converted into the coordinates of the pointer in the screen of the first external device 570. [ The concrete conversion method is the same as the conversion method using the screen size, and a detailed description will be omitted.

In the present embodiment, the size of the area 4020 corresponding to the screen of the first external device 570 is assumed to be the same as the size of the screen of the display device 100. However, the present invention is not limited to this, The size of the area 4020 corresponding to the screen of the display device 570 may be different from the size of the screen of the display device 100. [

In this case, on the basis of the size of the area 4020 corresponding to the screen of the first external device 570 and the size of the screen of the first external device 570 as described above, The coordinates of the pointer in the area 4020 corresponding to the screen of the external device 570 can be converted into the coordinates of the pointer on the screen of the first external device 570. [

The control unit 170 controls the first external device 570 using the ratio of the horizontal length of the area 4020 corresponding to the screen of the first external device 570 and the horizontal length of the screen of the first external device 570 The control unit 170 may convert the x coordinate of the pointer in the area 4020 corresponding to the screen of the first external device 570 to the x coordinate of the pointer of the first external device 570, In the area 4020 corresponding to the screen of the first external device 570 by using the ratio of the vertical length of the area 4020 corresponding to the screen of the first external device 570 and the vertical length of the screen of the first external device 570, The y coordinate of the pointer on the screen of the first external device 570 can be converted.

36, an operation method of the display apparatus 100 according to an embodiment of the present invention may include receiving (S3660) a second image from the first external device controlled in accordance with the instruction, (Step S3670).

This will be described in detail with reference to FIG.

42 is a view for explaining a method of the display device receiving and displaying an image displayed on the screen of the first external device;

37, when the input provided to the display device 100 is switched to an input provided from the first external device, the first external device 570 can provide an image to the display device 100, 100 has been described as receiving and displaying an image from the first external device 570.

37 that the display device 100 can receive and display an image displayed on the screen of the first external device 570. [

39 to 41, the first external device 570 receives the coordinates of the pointer and displays the pointer 4210 at a position corresponding to the received coordinates.

In this case, the first external device 570 can transmit the image 4210 including the pointer 4211 to the display device 100.

In this case, the controller 170 of the display device 100 can receive the image 4210 including the pointer 4211 from the first external device 570. The control unit 170 may control the display unit 180 to display the received image 4220.

That is, the display device 100 displays the image 4210 including the pointer 4211 as it is. On the screen of the display device 100, the pointer corresponding to the pointer 4211 displayed on the first external device 570, (4221) is also displayed as it is.

43 to 44 are diagrams for explaining a method of selecting an area where a pointer is located on a screen of a first external device according to an embodiment of the present invention.

As shown in FIG. 43, the pointer 4312 displayed on the screen of the first external device is located in a specific area on the screen of the first external device.

In this case, the user can click a button included in the remote control device 200 for selecting an area where the pointer 4312 is located.

Specifically, the remote control apparatus 200 may include a button corresponding to an input device of each of a plurality of external apparatuses. For example, when the first external device 570 is a notebook, the remote control device 200 may be a button of the mouse (at least one of a left click button, a right click button, and a wheel button) as an input device of the first external device 570, And a button corresponding to the button.

That is, the button for selecting the area where the pointer 4312 is located on the remote control device 200 may be a button corresponding to the left click button of the mouse which is the input device of the first external device 570.

On the other hand, the remote control device 200 can transmit the control signal corresponding to the input for selecting the area where the pointer 4312 is located to the display device 100. [

On the other hand, when the control signal corresponding to the input for selecting the area where the pointer 4312 is located is received from the remote control device 200, the control unit 170 of the display device 100 displays the pointer 4312 to the first external device 570. In this case,

On the other hand, the control unit of the first external device 570 can control the first external device 570 based on a command to select the area where the pointer 4312 is located.

For example, when an instruction to select an area in which the pointer 4312 is located is received, the control unit of the first external device 570 can perform an operation of selecting an area where the pointer 4312 is located. That is, the first external device 570 can perform the same operation as the operation of selecting the area where the pointer 4312 is located through the left mouse click.

In this case, a web browsing icon 4311 is displayed in the area where the pointer 4312 is located. Accordingly, when the area in which the pointer 4312 is located is selected, the control unit of the first external device 570 can control the first external device 570 in a manner of executing a web browser.

44, the control unit of the first external device 570 can control the first external device 570 in such a manner that the image 4410 of the executed web browser is displayed.

The control unit of the first external device 570 transmits the image 4410 displayed on the first external device 570 controlled based on the instruction to select the area where the pointer 4312 is located to the display device 100 .

The controller 170 of the display device 100 may receive the image 4420 provided by the first external device 570 controlled based on the instruction to select the area where the pointer 4312 is located, The received image 4420 can be displayed.

In the present embodiment, the movement of the pointer and the selection of the area where the pointer is located have been described, but the present invention is not limited thereto.

Specifically, the remote control device 200 may include a button corresponding to a button of another input device (or an input unit) except for a mouse among input devices (or input units) of the notebook. For example, the remote control device 200 may include a button corresponding to a power button constituting an input unit mounted on the notebook PC. On the other hand, when the pointer corresponding to the motion of the remote control device 200 is moved to the area outside the screen of the display device 100 and is located in the area corresponding to the screen of the first external device 570, The remote control device 200 can receive an input for selecting a button of the remote control device 200 corresponding to the power button of the notebook. The control unit 170 of the display device 100 may receive a control signal corresponding to the selected input from the remote control device 200. [ Also, the control unit 170 of the display device 100 may transmit a control command corresponding to the selected input to the notebook PC, and the notebook PC may turn off the notebook PC according to the received control command.

For example, when the external device is a Blu-ray player, a button corresponding to a button of a remote control device, which is an input device of the Blu-ray player, or a button corresponding to a button mounted on the Blu- The remote control device 200 of FIG. In addition, the user can control the Blu-ray player using the remote control device 200 of the display device 100 in the same manner as described above.

For example, when an input for selecting a button of the remote control device 200 corresponding to the fast forward button of the Blu-ray player is received, the remote control device 200 transmits a control signal corresponding to the selected input to the display device 100 ). Meanwhile, the controller 170 of the display apparatus 100 may transmit a control command corresponding to the selected input to the Blu-ray player. The Blu-ray player performs a fast-forward operation on the currently output image according to the received control command can do.

In addition, when the Blu-ray player performs the fast forward operation, the image (fast-forwarding image) provided by the Blu-ray player performing the fast forward operation can be transmitted to the display device 100, The control unit 170 of the control unit 170 can display a fast-forwarding image.

In the present embodiment, the notebook is controlled by selecting the button of the remote control device 200 corresponding to the left click button of the mouse, which is the input device of the notebook, but the present invention is not limited thereto. For example, the button of the remote control device 200 corresponding to the button of the remote control device 200 corresponding to the right-click button of the mouse or the button of the remote control device 200 corresponding to the wheel button of the mouse may be selected, .

The button corresponding to the button included in the input device of the external device mounted on the remote control device 200 may be provided separately from the button for controlling the display device 100. [

The button provided in the remote control device 200 for controlling the display device 100 is the same as the button provided in the remote control device 200 for controlling the first external device 570 Button. That is, control on the display device 100 and control on the first external device 570 can be performed based on the user input to the same button.

Specifically, the control unit 100 of the display device 100 can determine whether the control mode using the remote control device 200 is a mode for controlling the first external device 570 or a mode for controlling the display device 100 have.

More specifically, when the pointer corresponding to the motion of the remote control device 200 is located in the area of the screen of the display device 100, the control unit 100 of the display device 100 is provided with the remote control device 200 It can be determined that the input to the button is an input for controlling the display device 100. [ That is, when the pointer corresponding to the motion of the remote control device 200 is located in the area of the screen of the display device 100, the control unit 170 of the display device 100 receives a control signal from the remote control device 200 And when it is received, the display device 100 can be controlled based on the received control signal.

The pointer corresponding to the motion of the remote control device 200 is moved to the area outside the screen of the display device 100 and is located in the area corresponding to the screen of the first external device 570, The control unit 170 of the display device 100 judges that the input to the button provided in the remote control device 200 is an input for controlling the first external device 570 can do. That is, when the pointer is displayed on the screen of the first external device 570, the control unit 170 of the display device 100 receives the control signal from the remote control device 200, The first external device 570 can be controlled by transmitting a control command to the first external device 570. [

For example, when a pointer corresponding to the motion of the remote control device 200 is located in the area of the screen of the display device 100 and a volume up button included in the remote control device 200 is selected by the user, The controller 170 of the display device 100 can increase the volume of the display device 100. [ On the other hand, when the pointer is displayed on the screen of the first external device 570 and the volume up button included in the remote control device 200 is selected by the user, the control unit 170 of the display device 100 displays, Up command to the first external device 570. In this case, the first external device 570 can increase the volume of the first external device 570 according to the received command.

As another example, the specific button provided in the remote control device 200 may function as a button for changing the channel of the display device 100 when the pointer is located in the area of the screen of the display device 100 When the pointer is displayed on the screen of the first external device 570, the first external device 570 may function as a button for adjusting the brightness of the image displayed on the first external device 570.

In the present embodiment, the button corresponding to the button included in the input device (input unit) of the external device is provided in the remote control device 200, but the present invention is not limited thereto. For example, when the first external device 570 is a notebook, a UI corresponding to a button included in the keyboard, which is an input device of the notebook PC, may be displayed on the display device 100. That is, the UI corresponding to the button included in the input device of the external device can be displayed on the display device 100, and the external device can be controlled by selecting the UI displayed on the display device 100. This is explained in detail later.

FIGS. 45A and 45B are diagrams for explaining an operation method in the case where a pointer moved to an area outside the screen moves back to an area inside the screen, according to an embodiment of the present invention.

The current pointer 4441 is located in an area outside the screen of the display device 100 and is located in an area 4430 corresponding to the screen of the first external device 570. The pointer 4411 is displayed in the area of the screen of the first external device 570 corresponding to the position of the virtual pointer 4441 in the area 4430 corresponding to the screen of the first external device 570 .

44, the display device 100 is changed to a mode for controlling the first external device 570, so that the control signal received from the remote control device 200 is transmitted to the first external device 570 And is transmitting the control command corresponding to the control signal received by the remote control device 200 to the first external device 570. [

On the other hand, when the virtual pointer 4441 located in the area outside the screen moves back to the area inside the screen, the control unit 170 of the display device 100 displays, as shown in FIG. 45B, A pointer 4442 corresponding to the movement of the display device 100 can be displayed on the screen of the display device 100. [

The pointer 4442 corresponding to the movement of the remote control device 200 is displayed on the display device 100 as the pointer corresponding to the movement of the remote control device 200 moves from the area outside the screen to the area of the screen. The controller 170 of the display device 100 can change the operation mode that has been changed to the mode for controlling the first external device 570 to the operation mode for controlling the display device 100. [

Specifically, when a pointer corresponding to the motion of the remote controller 200 moves from the area 4430 outside the screen of the display device 100 to the area of the screen of the display device 100, The control unit 170 may determine that the input to the button included in the remote control apparatus 200 is an input for controlling the display apparatus 100. [ That is, when a control signal is received from the remote control device 200, the control unit 170 can control the display device 100 based on the received signal.

In this case, all operations for controlling the display device 100 using the remote control device 200 can be performed. In addition, an operation of switching the external device that provides the input to the display device 100 described in Figs. 2 to 35 may also be performed.

37 to 45, the control method in a state in which the external device providing the input to the display device 100 is switched to the first external device has been described, but the present invention is not limited thereto.

For example, as described with reference to FIGS. 2 to 35, when the pointer moves from the area of the screen to the area outside the screen, and the external device providing the input to the display device 100 is switched to the first external device, The control unit 170 of the display device 100 may switch the first external device to provide the input to the display device 100 and perform the control of the first external device described with reference to Figures 37 to 45 Can be implemented.

As described above, according to the present invention, there is provided an integrated remote controller capable of operating an external device through an input unit mounted on the external device, operating the external device using a remote controller capable of controlling the external device, It is possible to control all the external devices that provide input to the TV, even if only the remote control of the TV is used, without operating the external device.

In addition, the present invention enables intuitive control of an external device that provides an input to a display device by directly displaying a pointer moving in response to a remote controller of a TV to an external device providing input to the display device.

Further, the present invention can change an external device that provides an input to a TV and simultaneously display a pointer on the external device to control the external device. The switching of the input device and the control of the external device can be easily performed There are advantages to be able to.

The present invention also provides a method for providing a coordinate of a pointer to an external device by providing a transformed coordinate in consideration of the resolution of the screen and the size of the screen, , There is an advantage that a pointer displayed on an external device having a relatively small screen can be easily controlled.

Further, in the present invention, when an external device is controlled by an operation on a remote controller of a TV, an image provided by a controlled external device is displayed on a TV so that the user can check the control status through the screen of the external device, So that the control status of the external device can be confirmed.

36, 46, and 47, a method of controlling an external device when a display unit is not mounted on an external device that provides an input to the display device 100 will be described.

36, a step S3610 of receiving a first control signal including information on the motion of the remote control device from the remote control device in S3610, a pointer moving in accordance with the motion of the remote control device, (S3620) in which the input provided to the display device is switched to the external input when the display device is moved from the display area to the outside of the screen, all the methods described with reference to FIGS. 2 to 35 can be similarly applied, .

According to another aspect of the present invention, there is provided a method of operating a display device, the method comprising: receiving a first image from a first external device that provides input to a display device upon switching of an input, S3630).

This will be described in detail with reference to FIG.

46 is a diagram for explaining an operation in the case where an external device providing input to the display device 100 is a second external device having no display device.

Specifically, when the pointer moves from the area of the screen to the area outside the screen, the external device whose pointer corresponds to the direction out of the area of the screen, or the external device whose pointer corresponds to the boundary outside the area of the screen, It is possible to switch the input to the input provided by the external device corresponding to the boundary and direction outside the area. In this case, if the external device is the second external device 550, the controller 170 controls the input provided to the display device 100 from the second external device 550 among a plurality of external devices communicating with the display device You can switch to the provided input.

Here, it is assumed that the second external device 550 is a set-top box.

The second external device 550 can output an image to the display device 100. The control unit 170 of the display device 100 receives the image output from the second external device 550 and outputs the received image The display unit 180 may be controlled so as to display the display unit 4610. [

On the other hand, the second external device 550 does not include a display unit as a set-top box and can only output an image.

36, a method of operating a display device according to an embodiment of the present invention includes receiving (S3640) a second control signal from a remote control device, and generating a second control signal based on the second control signal, (S3650), receiving a second image from the first external device controlled according to the command (S3660), and displaying the second image (S3670).

The control unit 170 may receive a control signal corresponding to the input for controlling the second external device 550 from the remote control device 200. [

Specifically, the remote control device 200 may include a button corresponding to a button constituting the input device (or the input unit) of the second external device 550.

For example, when the input device of the second external device 550 is the second remote control device, the button corresponding to the button of the second remote control device, which is the input device of the second external device 550, 200). As another example, when an input unit including a button is attached to the second external device 550, a button corresponding to the button included in the input unit of the second external device 500 is included in the remote control device 200 .

In order to control the display device 100, the buttons of the remote control device 200 and the buttons of the remote control device 200 corresponding to the buttons of the second remote control device may be the same button.

The control unit 170 of the display device 100 may determine whether the control mode using the remote control device 200 is a mode for controlling the second external device 550 or a mode for controlling the display device 100 .

When the pointer corresponding to the motion of the remote control device 200 is located in the area of the screen of the display device 100, the control unit 100 of the display device 100 controls the operation of the remote control device 200 It can be determined that the input to the button is an input for controlling the display device 100. [

When the pointer corresponding to the motion of the remote control apparatus 200 is located in an area outside the screen of the display apparatus 100, the control unit 100 of the display apparatus 100 displays a button It can be determined that the input to the second external device 550 is an input to the second external device 550.

When the control mode using the remote control device 200 is a mode for controlling the second external device 550, the control unit 200 selects one of the plurality of buttons of the remote control device 200 corresponding to the plurality of buttons of the second remote control device When the user input for selecting the button is received, the remote control device 200 can transmit the control signal corresponding to the user input selected by the specific button to the display device 100.

When a control signal corresponding to the user input selected by the specific button is received from the remote control device 200, the control unit 170 of the display device 100 transmits a control command corresponding to the user input selected as the specific button to the second external To the device 500, and the second external device 550 can control the second external device according to the received control command.

For example, when a user input for selecting a specific button of the remote control device 100 corresponding to the channel change button of the second remote control device is received, the remote control device 200 selects the button corresponding to the user input And transmit the control signal to the display device 100. [ In this case, the controller 170 may transmit a control command to the second external device 550 to change the channel based on the received control signal.

Meanwhile, the control unit of the second external device 500 can control the second external device 500 according to the received control command. For example, the control unit of the second external device 550 may receive the broadcast content of the changed channel according to the received channel change command, and may provide the broadcast image of the changed channel to the display device 100.

On the other hand, the controller 170 of the display device 100 can receive the controlled image (broadcast image of the changed channel) based on the control command for controlling the second external device 550, The display unit 180 can be controlled.

47A and 47B are views for explaining a control method for an external device when the second external device does not include a display device, according to another embodiment of the present invention.

When the input provided to the display device 100 is switched to the input provided by the second external device 550 and the specific input is received, the control unit 170 of the display device 100 transmits the second external device 550 (4711, 4712, 4713, 4714, 4715) for controlling the UI (4711, 4712, 4713, 4714, 4715).

Specifically, when the remote control device 200 receives a specific input for controlling the second external device 550, the remote control device 200 can transmit the signal corresponding to the specific input to the display device 100 .

The control unit 170 of the display device 100 can display one or more UIs 4711, 4712, 4713, 4714, 4715 for controlling the second external device 550 have.

Here, one or more UIs 4711, 4712, 4713, 4714, and 4715 for controlling the second external device 550 may correspond to the respective buttons attached to the input device of the second external device 500, respectively.

For example, when the remote controller of the set-top box includes a power button, a channel change button, a volume button, a menu button, and an exit button, one or more UIs 4711, 4712, 4713 for controlling the second external device 550 4714 and 4715 correspond to the power button, the channel change button, the volume button, the menu button and the exit button provided on the remote controller of the set-top box, respectively.

47B, when the specific UI 4712 of one or more UIs 4711, 4712, 4713, 4714, and 4715 is selected by the user input as the pointer 4720 moves, the display device 100 may transmit a control command corresponding to the selected specific UI 4712 to the second external device 550. For example, when the channel up UI is selected, the controller 100 of the display device 100 may transmit a channel up command to the second external device 550. [

On the other hand, the control unit of the second external device 550 can control the second external device 550 based on the command received from the display device 100. For example, when a channel up command is received from the display apparatus 100, the control unit of the second external apparatus 550 can receive broadcast contents corresponding to a higher number of channels. The second external device 500 can transmit broadcast contents corresponding to a higher number of channels to the display device 100 and the control unit 170 of the display device 100 displays the received broadcast content The display unit 180 can be controlled.

As described above, the present invention provides an environment in which an external device can be easily controlled by a remote controller of a TV even when the external device does not include a display unit.

Referring again to FIG. 36 and FIG. 48 to FIG. 50, a method of controlling an external device using an image displayed on the display device 100 when the display device is mounted on an external device according to another embodiment of the present invention will be described do.

48 is a diagram for explaining an operation when the third external device providing input to the display device 100 is a cellular phone,

A method of operating a display device according to another exemplary embodiment of the present invention includes receiving a first image from a third external device that provides an input to a display device in response to input switching and displaying a first image in operation S3630, . &Lt; / RTI >

Specifically, the controller 170 may control the display unit 180 to receive the image from the third external device 580 (cellular phone) and display the received image 4820.

Here, the image received from the third external device 580 may be the image 4810 displayed on the screen of the third external device 580. That is, the image 4820 displayed on the display device 100 and the image 4810 displayed on the third external device 580 may be the same image.

Accordingly, when the image 4810 displayed on the third external device 580 includes one or more icons 4811, 4812, 4813, 4814, 4815, 4816, 4817, 4818, 4819, The displayed image 4820 may also include one or more icons 4821, 4822, 4823, 4824, 4825, 4826, 4827, 4828,

Meanwhile, the controller 170 of the display device 100 may display the UI 4830 corresponding to the button mounted on the third external device 580.

For example, when the third external device 580 is equipped with a first button for lifting up the volume, a second button for lowering the volume, and a third button for turning on / off the power, , The controller 170 may display a first UI 4831 corresponding to the first button, a second UI 4832 corresponding to the second button, and a third UI 4833 corresponding to the third button.

49 is a diagram for explaining a method of receiving a user input for selecting a specific area on the screen of the display device.

The method of operating the display device according to the embodiment of the present invention may include receiving (S3640) a second control signal from the remote control device.

49, the control unit 170 of the display device 100 can display a pointer 4910 that moves in response to the movement of the remote control device.

When receiving the user input for selecting the area where the pointer 4910 is located, the remote control device 200 transmits the signal corresponding to the user input for selecting the area where the pointer 4910 is located to the display device 100 Lt; / RTI >

The control unit 170 may receive a signal corresponding to a user input for selecting an area where the pointer 4910 is located, from the remote control device 200. [

Meanwhile, a method of operating a display device according to an exemplary embodiment of the present invention may include transmitting a command to an external device based on a second control signal (S3650).

Specifically, based on the signal corresponding to the user input for selecting the area where the pointer 4910 is located, the control unit 170 of the display device 100 selects the area corresponding to the area where the pointer 4910 is located To the third external device (580).

In this case, the instruction for selecting the area corresponding to the area in which the pointer 4910 is located is information on the coordinates of the pointer 4910 in the image 4820 displayed on the display device 100, The coordinates of the pointer 4910 in the image 4820 displayed on the first external device 580 and the coordinates of the coordinates of the pointer 4910 in the image 4820 displayed on the third external device 580 are converted into coordinates corresponding to the screen size of the third external device 580.

On the other hand, a user input for selecting the first UI 4831 of the first UI 4831, the second UI 4832, and the third UI 4833 corresponding to the button mounted on the third external device 580 is received The control unit 170 of the display device 100 may transmit a command to the third external device 580 indicating that the button corresponding to the first UI 4831 is selected.

50 is a diagram showing a third external device 580 and a display device which have received an instruction.

When an instruction to select an area corresponding to an area where the pointer 4910 is located is received, the third external device 580 can perform an operation corresponding to an area corresponding to an area where the pointer 4910 is located.

For example, in Fig. 49, an icon 4821 corresponding to the messenger application is displayed in the area where the pointer 4910 is located. An icon 4811 corresponding to the messenger application is also displayed in an area on the screen of the third external device 580 corresponding to the area where the pointer 4910 is located.

In this case, when an instruction to select an area corresponding to the area in which the pointer 4910 is located is received, the third external device 580 displays the area corresponding to the area in which the pointer 4910 is located, An icon 4811 corresponding to the messenger application can perform the selected operation. Thus, the third external device 580 can execute the messenger application and display the execution image 5010 of the executed messenger application.

In addition, the third external device 580 can transmit the execution image 5010 of the messenger application to the display device 100. [

It is also assumed that the button corresponding to the first UI 4831 of the first UI 4831, the second UI 4832 and the third UI 4831 corresponding to the button mounted on the third external device 580 is selected The third external device 580 can perform an operation corresponding to the received command.

That is, when an instruction indicating that the button corresponding to the first UI 4831 is selected is received, the third external device 580 can control the third external device 580 according to the received instruction. For example, when the button corresponding to the first UI 4831 is a volume up button, the controller of the third external device 580 can increase the volume of the sound output from the third external device 580.

Meanwhile, an operation method of a display apparatus according to an embodiment of the present invention may include a step (S3660) of receiving a second image from an external device controlled according to the command and a step (S3670) of displaying the second image .

That is, the display device 100 displays the image (the execution image 5010 of the messenger application) transmitted from the third external device 580, which is controlled by a command for selecting an area corresponding to the area where the pointer 4910 is located, Can be received.

Also, the display device 100 can display the execution image 5020 of the received messenger application.

However, the present invention is not limited thereto. For example, even when the external device that provides the input to the display device 100 is a notebook, the present embodiment can be applied.

For example, when the image displayed on the notebook includes a specific icon, the image received and displayed by the display device 100 from the notebook may also include a specific icon.

In this case, when a user input for selecting an area where a specific icon is located is received, the control unit 170 of the display device 100 may transmit a command to the notebook to select an area corresponding to the area where the specific icon is located, An area corresponding to an area where a specific icon is located can be selected. For example, when the specific icon is a web browser icon, the notebook can execute the web browser and display the execution image of the web browser.

As another example, a UI corresponding to a button included in the input device of the notebook, e.g., a button included in the keyboard, may be displayed on the display device 100.

When a user input for selecting a specific UI among a plurality of UIs corresponding to the plurality of buttons included in the keyboard is received, the display device 100 can transmit a command indicating that a specific UI is selected to the notebook.

In this case, the notebook receiving the command can perform an operation corresponding to the received command. For example, if the UI corresponding to the letter " K " button is selected while the text input window is active, the notebook may display the letter " K "

As described above, although the external device providing the input to the display device includes the display unit, the display image on the external device and the UI corresponding to the button on the external device can be displayed on the display device. Therefore, the present invention can provide an environment in which a user can control an external device using an image displayed on a TV.

Particularly, when an external device providing input to a display device is an external device having a relatively small screen size (such as a cellular phone), a display image of the mobile phone is displayed on a TV so that a user moves the pointer using the remote control It is possible to provide an environment that can be easily made using a TV screen.

The display device 100 and a plurality of external devices may be installed with an application capable of supporting a common protocol in communication between the display device 100 and a plurality of external devices.

On the other hand, the control unit 170 is generally configured to control the apparatus, and may be used in combination with terms such as a central processing unit, a microprocessor, a processor, and the like.

According to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described display device is not limited to the configuration and method of the above-described embodiments, but the embodiments may be configured such that all or some of the embodiments are selectively combined so that various modifications can be made. It is possible.

135: external input interface unit 150: user input interface unit
170: control unit 180:

Claims

A method of operating a display device,
Receiving from the remote control device a first control signal including information on movement of the remote control device;
Switching an input provided to the display device to an external input when a pointer moving in response to a movement of the remote control device moves from a screen area of the display device to an area outside the screen;
Receiving a first image from a first external device providing an input to the display device as the input provided to the display device is switched, and displaying the first image;
Receiving a second control signal from a remote control device;
Transmitting an instruction to the first external device based on the second control signal;
Receiving a second image from the first external device controlled according to the command; And
And displaying the second image
A method of operating a display device.

The method according to claim 1,
Wherein the step of converting an input provided to the display device into an external input includes:
When the pointer moves from an area of the screen to an area outside the screen, switches the input provided to the display device to an input provided from the first external device among a plurality of external devices communicating with the display device,
Wherein the first external device comprises:
Wherein the pointer corresponds to a first one of a plurality of directions deviating from an area of the screen,
A first boundary of the plurality of boundaries of the area of the screen,
A second boundary of a plurality of boundaries of the region of the screen and a second boundary of the plurality of boundaries that correspond to a second one of the plurality of directions
A method of operating a display device.

The method according to claim 1,
Wherein the step of receiving the second control signal comprises:
And receiving a second control signal including information on the motion of the remote control device,
Wherein the step of transmitting an instruction to the first external device comprises:
When the pointer moves from the area of the screen to the area outside the screen based on the information on the motion of the remote control device included in the second control signal, the pointer in the area corresponding to the screen of the first external device Obtaining the coordinates of the object; And
And transmitting coordinates of a pointer in an area corresponding to a screen of the first external device to the first external device,
Wherein the receiving the second image comprises:
Receiving the second image including the second pointer 'displayed on the first external device based on the coordinates of the pointer in the area outside the screen from the first external device
A method of operating a display device.

The method of claim 3,
A method of operating the display device,
Receiving from the remote control device a third control signal corresponding to an input for selecting an area where the second pointer is located;
Transmitting an instruction to the first external device to select an area in which the second pointer is located based on the third control signal; And
Further comprising receiving from the first external device a third image provided by the first external device controlled based on an instruction to select an area in which the second pointer is located
A method of operating a display device.

The method of claim 3,
A method of operating the display device,
Further comprising receiving information on a resolution of a display unit of the first external device,
Wherein the step of transmitting the coordinates of the pointer in the area corresponding to the screen of the first external device to the first external device comprises:
Converting the coordinates of the pointer in the area corresponding to the screen of the first external device into the coordinates corresponding to the resolution based on the information about the resolution of the display part of the first external device, 1 Transfer to an external device
A method of operating a display device.

The method according to claim 1,
Wherein the step of receiving the second control signal comprises:
And receiving the second control signal corresponding to an input for controlling the first external device,
Wherein the step of transmitting an instruction to the first external device comprises:
Transmits a command for controlling the first external device to the first external device based on the second control signal,
Wherein the receiving the second image comprises:
Receiving the second image provided by the first external device, which is controlled based on a command for controlling the first external device, from the first external device
A method of operating a display device.

The method according to claim 6,
Wherein the displaying the first image comprises:
Displaying a UI corresponding to a button mounted on the first external device together with the first image; And
And displaying a moving pointer corresponding to the motion of the remote control device together with the first image,
Wherein the input for controlling the first external device comprises:
An input for selecting an area where the pointer is located in the first image,
An input for selecting a UI corresponding to a button mounted on the first external device
A method of operating a display device.

In the display device,
A display unit for displaying an image;
A user input interface unit for receiving a control signal from the remote control device;
An external input interface unit for receiving an input provided to the display device; And
A remote control device according to claim 1, further comprising: a first control signal including information on a motion of the remote control device from the remote control device; and a pointer moving in accordance with the motion of the remote control device moves from an area of the screen of the display device The first image is received and displayed by the first external device which provides the input to the display device as the input provided to the display device is switched, Receiving a second control signal from the device, transmitting a command to the first external device based on the second control signal, and receiving and displaying a second image from the first external device controlled according to the command Comprising a control section
Display device.

9. The method of claim 8,
Wherein,
When the pointer moves from an area of the screen to an area outside the screen, switches the input provided to the display device to an input provided from the first external device among a plurality of external devices communicating with the display device,
Wherein the first external device comprises:
Wherein the pointer corresponds to a first one of a plurality of directions deviating from an area of the screen,
A first boundary of the plurality of boundaries of the area of the screen,
A second boundary of a plurality of boundaries of the region of the screen and a second boundary of the plurality of boundaries that correspond to a second one of the plurality of directions
Display device.

9. The method of claim 8,
Wherein,
And a controller for receiving a second control signal including information on a motion of the remote control device, and based on information about a motion of the remote control device included in the second control signal, Acquires the coordinates of the pointer in the area corresponding to the screen of the first external device and transfers the coordinates of the pointer in the area corresponding to the screen of the first external device to the first external device, Receiving the second image including the second pointer 'displayed on the first external device based on the coordinates of the pointer in the area outside the screen from the first external device
Display device.

11. The method of claim 10,
Wherein,
A command for selecting an area in which the second pointer is located based on the third control signal is received from the remote control device in response to a third control signal corresponding to an input for selecting an area in which the second pointer is located, Receiving a third image, which is controlled by the first external device, based on a command to select an area in which the second pointer is located, from the first external device;
Display device.

11. The method of claim 10,
Wherein,
Wherein the first external device receives the information on the resolution of the display unit of the first external device and determines the coordinates of the pointer in the area corresponding to the screen of the first external device based on the resolution of the display unit of the first external device, And transmits the converted coordinates to the first external device
Display device.

9. The method of claim 8,
Wherein,
The first external device receives the second control signal corresponding to the input for controlling the first external device and transmits a command for controlling the first external device to the first external device based on the second control signal, Receiving the second image provided by the first external device, which is controlled based on a command for controlling the first external device, from the first external device
Display device.

14. The method of claim 13,
Wherein,
A UI corresponding to a button mounted on the first external device and a pointer moving according to a movement of the remote control device together with the first image,
Wherein the input for controlling the first external device comprises:
An input for selecting an area where the pointer is located in the first image,
An input for selecting a UI corresponding to a button mounted on the first external device
Display device.