KR101265648B1 - Display apparatus connected with at least one device by using intergrated interface and method for controlling the same - Google Patents

Abstract

A display device connected to at least one device according to an embodiment of the present invention through an integrated interface includes an external device interface for receiving data representing at least one function from an external device, A display module for displaying an image corresponding to each function, a receiving module for receiving a signal for selecting a specific image from the displayed images from the remote controller, a sensor for detecting a position value in the screen of the received signal, And a controller for extracting information corresponding to the sensed position value from the memory, and the external device interface transmits the information to the external device.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a display device and a control method thereof,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device, and more particularly, to a display device and a control method thereof connected to at least one device through an integrated interface. The display device corresponds to, for example, a network TV, a smart TV, a Hybrid Broadcast Broadband Television (HBBTV), an Internet TV, a Web TV, an IPTV (Internet Protocol Television)

Recent technological advances have led to the emergence of new digital devices that have not existed before. Also, in order to connect various kinds of devices, an interface suitable for each device is required. Hereinafter, the state of the prior art will be described with reference to FIG.

1 is a diagram showing an embodiment in which a plurality of general electronic devices are controlled by a unique remote controller. 1, the display device 100 according to the related art includes various devices such as a set top box (STB) 200, a BD (Blu-ray Disc, Blu-ray Disc) player 300, It is connected to various devices.

1, the display device 100, the set-top box 200, and the BD player 300 are provided with unique remote controller signals wirelessly transmitted from the respective remote controllers 500, 400, and 600 An infrared receiver (IR receiver) for receiving is installed on the front side of the device.

Therefore, according to the related art, there is a disadvantage that all of the remote controllers 400 and 600 corresponding to the respective devices are required to control the devices 200 and 300 connected to the display device 100. For example, if the number of devices connected to the display device 100 is seven, there are seven remote controllers as well.

In addition, even when one remote controller is used to control the display device 100 and the connected devices 200 and 300, it is often difficult that some external devices do not support the remote controller 500 of the display device .

In most cases, computers such as tablet PCs and notebook computers do not support the remote controller 500 of the display device 100 such as a TV. Accordingly, when the computer is connected to a display device having a large screen size such as a TV to view an image, the remote controller 500 of the display device 100 has a problem that the computer can not be controlled.

Therefore, according to the related art, there is a problem that the external devices connected to the display device 100 are more easily controlled and a more optimized user interface can not be provided to the user.

An embodiment of the present invention provides an integrated interface for controlling an external device connected to the display device through a remote controller of the display device.

Another embodiment of the present invention is to define a data transmission protocol for providing an integrated interface between a display device and an external device connected to the display device.

Another embodiment of the present invention provides an integrated interface capable of easily controlling an external device through a remote controller of a display device when an external device such as a computer is connected to the display device.

A display device connected to at least one device according to an embodiment of the present invention through an integrated interface includes an external device interface for receiving data representing at least one function from an external device, A display module for displaying an image corresponding to each function, a receiving module for receiving a signal for selecting a specific image from the displayed images from the remote controller, a sensor for detecting a position value in the screen of the received signal, And a controller for extracting information corresponding to the sensed position value from the memory, and the external device interface transmits the information to the external device.

A method of controlling a display device connected to at least one device according to an embodiment of the present invention through an integrated interface includes displaying an image received from an external device, Receiving an input signal, converting the received input signal into data that can be processed by the external device, and transmitting the converted data to the external device.

According to an embodiment of the present invention, an integrated interface for controlling an external device connected to the display device through a remote controller of a display device is provided, so that an external device can be easily controlled with only one remote controller.

According to another embodiment of the present invention, there is an effect of defining a data transmission protocol between a display device and an external device, which is necessary in the process of implementing an integrated interface between a display device and an external device connected to the display device.

According to another embodiment of the present invention, when a computer such as a tablet PC or a notebook computer is connected to an external device by a display device, an integrated interface capable of easily controlling a computer through a remote controller of the display device is provided , It is possible to maximize the function of the remote controller of the display device as well as to provide convenience to the user.

The effects of the more specific invention will be described later in detail in the following table.

1 is a diagram showing an embodiment in which a plurality of general electronic devices are controlled by a unique remote controller.
2 is a block diagram of a display device connected to at least one device according to an embodiment of the present invention through an integrated interface.
3 is a view illustrating an exemplary menu of an external device in a display device according to an exemplary embodiment of the present invention.
4 is a diagram illustrating a menu of an external device in a display device according to another embodiment of the present invention.
5 is a block diagram of a memory of a display device according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating another embodiment of the memory of the display device according to the present invention.
7 is a diagram illustrating an embodiment of an external device interface in a display device according to the present invention.
8 is a view illustrating an example of a menu of an external device supporting a remote controller in a display device according to an embodiment of the present invention.
9 is a diagram illustrating a menu of an external device which does not support the remote controller of the display device according to an embodiment of the present invention.
10 is a diagram illustrating a menu of an external device that does not support a remote controller in a display device according to another embodiment of the present invention.
11 is a diagram showing an outer appearance of a remote controller for controlling a display device according to an embodiment of the present invention.
12 is a diagram showing a detailed configuration module of the remote controller shown in Fig.
13 is a diagram illustrating an entire system including an external display device according to another embodiment of the present invention and a display device connected with an integrated interface.
14 is a diagram illustrating an embodiment of displaying a virtual keyboard in a display device according to the present invention.
FIG. 15 is a diagram illustrating another embodiment for displaying a virtual keyboard in the display device according to the present invention.
16 is a flowchart of a method of controlling a display device connected to at least one device according to an embodiment of the present invention through an integrated interface.
17 is a flowchart showing a data transmission protocol between the remote controller, the display device, and the external device according to the method of FIG.
18 is a flowchart of a method of controlling a display device connected to at least one device according to another embodiment of the present invention through an integrated interface.
FIG. 19 is a flowchart showing a data transfer protocol between the remote controller, the display device, and the external device according to the method of FIG.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

Meanwhile, the display device described in this specification is an intelligent network TV that adds a computer support function to a broadcast receiving function, for example, and is equipped with an Internet function while being faithful to a broadcast receiving function, It is possible to provide a convenient interface for use of a remote controller or the like. With the support of wired or wireless internet function, it can be connected to internet and computer and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Therefore, the display device described in the present invention can freely add or delete various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed.

Furthermore, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings and the accompanying drawings, but the present invention is not limited to or limited by the embodiments.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

2 is a block diagram of a display device connected to at least one device according to an embodiment of the present invention through an integrated interface. It should be noted that FIG. 2 is one embodiment for explaining the present invention, and it is within the scope of the present invention to delete some configuration modules or add new configuration modules according to needs of those skilled in the art.

2, a display device 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, a memory 140, a controller 150, a sensor 160, a user interface 170, A device interface 180, a display unit 190, an audio output unit 191, and a power supply unit 193.

The broadcast receiver 105 may include a tuner 110, a demodulator 120, and a network interface 130. Of course, the tuner 110 and the demodulation unit 120 may be omitted, but the network interface 130 may not be included. Alternatively, the tuner 110 and the demodulation unit 120 may be provided, It is also possible to design so as not to include the heat sink 120.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The stream signal output from the demodulation unit 120 may be input to the controller 150. The controller 150 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display unit 190 and outputs audio to the audio output unit 191.

The external device interface 180 can connect to an external device and a network device. To this end, the external device interface 180 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface 180 can be connected to an external device such as a DVD (Digital Versatile Disk), a BD (Blu-ray Disc, Blu-ray Disc) player, a game device, a camera, a camcorder, a computer . In addition, the external device interface 180 may receive an application or application list in an adjacent external device and forward it to the controller 150 or the memory 140.

The network interface 130 may include, for example, an Ethernet terminal or the like for connection with a wired network. For example, a WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access Can be used. In addition, the network interface 130 can select and receive a desired application among applications open to the public via the network.

The memory 140 may be implemented by an EEPROM (Electrically Erasable Programmable Read-Only Memory) or the like and may store programs for processing and controlling each signal in the controller 150, It is possible.

The memory 140 may also function for temporary storage of video, audio, or data signals input from the external device interface 180 or the network interface 130. Further, the memory 140 may store a list of applications or applications that are input from the external device interface 180 or the network interface 130.

The user interface 170 transfers a signal input by the user to the controller 150 or the sensor 160 or a signal from the controller 150 to the user. For example, the user interface 170 can be turned on / off from the remote controller 500 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method, Selection, screen setting, or the like, or to transmit a control signal from the controller 150 to the remote controller 500. [0157]

The display unit 190 converts an image signal, a data signal, an OSD signal processed by the controller 150 or an image signal and a data signal received from the external device interface 180 into R, G, and B signals, respectively, . The display unit 190 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The audio output unit 191 receives a voice processed signal, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal from the controller 150, and outputs the voice. The audio output unit 191 may be implemented by various types of speakers.

The power supply unit 193 supplies the corresponding power supply throughout the display device 100. For example, a controller 150, which can be implemented as a system on chip (SOC), a display unit 190 for displaying an image, and an audio output unit 191 for audio output, Can be supplied.

The remote controller 500 transmits the user input to the user interface 170. For this purpose, the remote controller 500 may use Bluetooth, RF (Radio Frequency) communication, IR (infrared) communication, UWB (Ultra Wideband), ZigBee, or the like. Particularly, the remote controller 500 will be described later with reference to FIG. 11 and FIG.

In particular, a display device 100 connected to at least one device through an integrated interface will now be described.

The external device interface 180 receives data indicative of at least one function from an external device. Then, the display unit 190 displays an image corresponding to each function using the received data.

The image corresponding to each function is data displayed on the screen so that the function of the external device can be used by the user, and is data converted into R, G, and B signals. An example of the image is an image of a menu of an external device displayed on the screen so that the user can control the external device. The function of the external device is available through the menu of the external device. This will be described in more detail with reference to FIG. 3 and FIG.

FIG. 3 is a diagram showing a menu of an external device in a display device according to an embodiment of the present invention. Referring to FIG. 3, the external device is a BD (Blu-ray Disc) ). ≪ / RTI >

That is, a chapter 181, a caption language 182, and a special feature 183 of the BD player are shown on the display unit 190 of the display device 100 and the remote controller 500 of the display device 100 And a pointer 501 corresponding to the pointer 501 is displayed. Therefore, the menu of the BD player can be selected through the pointer 501 of the remote controller 500. In FIG. 3, it is an embodiment to select the caption language 182 which is the menu of the BD player.

FIG. 4 is a diagram illustrating a menu of an external device in a display device according to another embodiment of the present invention, in which the external device is a BD (Blu-ray Disc, Blu-ray Disc) player. The BD player menu includes a Title Menu 184 for selecting the title of the BD player, a Main Menu 185 for selecting the entire menu of the BD player, Play (186 ), Pause (187), Stop (188), and Rewind (189).

At this time, a pointer 501 corresponding to the remote controller 500 is displayed so that the menu can be selected through the remote controller 500 of the display device 100. [ The pointer 501 may vary according to the movement of the remote controller 500, and will be described later with reference to FIGS. 11 and 12. FIG.

The user interface 170 includes a receiving module, and the receiving module receives a signal from the remote controller 500 to select a specific image from the images corresponding to the respective functions of the external apparatus. The sensor 160 senses the position of the received signal in the screen and determines what the signal is for. The signal received by the user interface 170 may be a signal for the display device 100 itself or a signal for an external device according to the image.

Accordingly, the sensor 160 extracts a coordinate value of a signal received from the user interface 170, and extracts a menu of an external device corresponding to the coordinate value if the signal is a signal to an external device.

At this time, the sensor 160 may refer to the memory 140 to extract the menu of the external device corresponding to the coordinate value. The basic data for sensing a signal is stored in the memory 140. The basic data includes the screen resolution of the display device 100, the resolution of the external device, the number of data indicating the function of the external device, And data regarding a coordinate value of the image corresponding to the position on the screen and the size thereof.

As described above, when an image corresponding to each function of the external apparatus is displayed, the user can recognize the menu as the menu of the external apparatus. Therefore, the basic data includes a menu number of the external apparatus, a coordinate value And data on the size of the menu.

5 is a block diagram of a memory of a display device according to an embodiment of the present invention. As shown in FIG. 5, a menu ID is assigned to a menu of an external device, and x and y coordinates of a position displayed on the screen of the display device 100 for each menu ID are stored. In addition, since the horizontal size and the vertical size are stored together, the combination of the x coordinate and the horizontal size, and the y coordinate and the vertical size indicate the position where the menu is displayed on the screen and the size of the displayed area. However, if the resolution of the screen differs from that of the external device, the resolution conversion process must be performed first.

Accordingly, the sensor 160 refers to the memory 140 on the basis of the x-coordinate and the y-coordinate according to the signal of the remote controller 500 received from the user interface 170 and extracts the menu ID to determine which menu is selected .

The controller 150 extracts information corresponding to the sensed position value from the memory 140. That is, when the sensor 160 senses the position value in the screen and confirms which menu is selected for the signal received by the user interface 170, information corresponding to the position value is extracted from the memory 140 do.

The information may include control data, which may be an instruction code that directly controls the external device according to the function of the external device, or an identification code of data that indicates the function of the external device. For example, the command code may be a command code that can directly perform a function corresponding to a menu, and may be a code of a modified form so that the external device can recognize the menu ID.

Therefore, the external device that receives the information, that is, the control data through the external device interface 180, directly controls the control data through the control data if the control data is an instruction code. However, if the control data is an identification code, the controller refers to the control data and confirms the function corresponding to the control data, and controls the control data according to the function.

FIG. 6 illustrates another embodiment of the memory of the display apparatus according to the present invention. As shown in FIG. 6, corresponding control data for each menu ID is stored. As described above, the control data may be an instruction code capable of controlling an external device, and the external device may be an identification code capable of identifying a menu ID of the external device.

As described above, the memory 140 stores the control data corresponding to the position value in the form of a table so that the controller 150 can easily extract the control data.

5 and 6, the table storing the menu ID according to the coordinate value, i.e., the position value, and the table storing the control data according to the menu ID are separately stored, This is advantageous. For example, when only the position of the menu is changed, only the contents of the table shown in FIG. 5 need to be changed. When the control of the external device according to the menu is different, only the contents of the table shown in FIG. 6 are changed do. If the menu ID is different but the operation to be performed is the same, only the menu ID corresponding to one control data is added. In this manner, management of the control data according to the menu is easy by managing the table separately.

The external device interface 180 may include a Digital Interactive Interface for Video & Audio (DiiVA) or an HDMI CEC (High-Definition Multimedia Interface Consumer Electronics Control) function. Where the Diva is a new consumer electronics (CE) home networking interface that transmits uncompressed audio and audio over a stable high-speed bidirectional data channel.

7 is a diagram illustrating an external device interface in the display device according to the present invention, wherein the external device interface may be the above-described device. Hereinafter, referring to FIG. 7, an overall system including a display device connected to at least one device and an integrated interface according to an embodiment of the present invention will be described.

First, the display device 100 according to an embodiment of the present invention does not need to be individually connected to a plurality of external devices. The display device 100 corresponds to, for example, a TV, a DTV, a smart TV, a network TV, and the like.

7, the display device 100 may include a single device (although it is shown as the Blu-ray Disc 300 in FIG. 7, but may be another device) and an integrated interface according to an external device interface And other devices (e.g., STB 200, AV Receiver 400, game console 500, etc.) are connected to an integrated interface between the devices. At this time, the display device 100 according to an embodiment of the present invention can receive data from other devices as well as devices directly connected to the integrated interface.

Of course, it is also within the scope of the present invention to transmit and receive data through a unified interface to a plurality of external devices directly connected to the display device 100, unlike the one shown in FIG.

1, there is a problem that a separate remote controller is required for each external device in FIG. 1. However, the display device 100 shown in FIG. 7 has a problem in that a single remote controller corresponding to the display device 100 The remote controller 500 can control all external devices.

HDMI (High-Definition Multimedia Interface) is an interface that simultaneously transmits digital video and audio signals over a single cable. When both the playback device and the output device are equipped with an HDMI terminal (port) Video and sound can be transmitted.

In addition, the HDMI CEC function refers to a function of controlling the devices connected to each other by using the 13 pin of the HDMI cable as a control line. For example, by using the HDMI CEC function, it is possible to directly control the play, stop, skip function, etc. of a DVD player, STB, etc. connected by an HDMI cable on the TV side.

8 is a view illustrating an example of a menu of an external device supporting a remote controller in a display device according to an embodiment of the present invention. For example, when the external device interface 180 supports the HDMI CEC function, a remote controller 500 may be connected to the remote controller 500 to select and control the menu of the BD player, The menu of the BD player can be selected by the pointer 501 corresponding to the menu 500.

However, even if the HDMI CEC function is used, the inconvenience of the user still exists. For example, when the playback of the BD player is completed, the user must manually turn off the display device 100 and the BD player to turn off the display device 100 and the BD player . That is, there is a part where the user must separately adjust the display device 100 and the external device, respectively.

If the external device does not support the remote controller 500 of the display device 100, there is an inconvenience that the remote controller of the external device must be used separately. In the present invention, an external device can be controlled by the remote controller 500 of the display device 100 using a virtual control related image. This will be described in detail.

9 is a diagram illustrating a menu of an external device that does not support a remote controller of a display device according to an exemplary embodiment of the present invention in a display device. In order to solve the above problem, .

Even if an image corresponding to each function of the external apparatus, that is, a menu of the external apparatus, is displayed on the display apparatus, the remote controller 500 of the display apparatus 100 does not support the remote controller 500 of the display apparatus 100 500), the menu of the external device can not be selected. Accordingly, it is desirable to select a menu of the external device using the virtual control related image 700 that the remote controller 500 can select.

The controller 150 controls the display unit 190 to display a virtual control related image on the screen and the user interface 170 receives the virtual control related image from the remote controller 500 through the receiving module, Lt; / RTI > At this time, the controller 150 may control the display unit 190 to display a specific image among the images corresponding to the respective functions according to a signal for the virtual control related image.

The virtual control related image 700 may include images for the four direction keys of image 730, bottom 740, left 710 and right 720, May further include an image for the user. When a virtual control related image 700 is selected by using the remote controller 500, an effect of selecting a menu of the external apparatus is obtained.

9, the chapter 181 menu is selected. When the right direction key 720 of the virtual control related image 700 is selected, the caption language 182 on the right side of the chapter 181 menu, Special Feature 183 may be selected in order.

At this time, the sensor 160 recognizes the signal for the virtual control related image 700 as a signal for the specific image, and detects the position value of the specific image in the screen. Therefore, there is an effect that a signal for the virtual control related image is recognized as a signal for the menu of the external apparatus through the sensor 160.

That is, the display unit 190 displays only the menu of the external device according to the virtual control-related image selected by the user, and internally, the sensor 160 displays the external It is recognized that the menu of the device is selected.

In detail, the sensor 160 senses a position value on the screen of the signal received by the user interface 170. [ If the signal is a signal for the virtual control related image 700, the positional information on the screen of the external device corresponding to the virtual control related image 700 is sensed.

For example, it is assumed that the signal received by the user interface 170 is the right direction key 720 of the virtual control related image 700 as a result of sensing the position value in the sensor 160. The sensor 160 refers to the memory 140 storing the coordinate value of the menu 181 of the currently selected external device and updates the coordinate value by increasing the x coordinate value by a predetermined size.

If the signal received at the user interface 170 is a left direction key 710 of the virtual control related image 700, the coordinate value is updated by decreasing the x coordinate value by a predetermined size, and the upward direction key 730), the y coordinate value is increased by a predetermined size to update the coordinate value, and when the down direction key 740 is selected, the y coordinate value is decreased by a predetermined size to update the coordinate value. Then, the menu 182 of the external apparatus corresponding to the updated coordinate value can be extracted.

As shown in FIG. 9, if the virtual control related image 700 is a direction key, the menu of the external device must be changed and selected according to the direction key. Therefore, the size of the coordinate value to be changed according to the direction key may be stored in the memory 140, and the menu of the external device corresponding to the updated coordinate value may be extracted by reflecting the size. At this time, the coordinate value is updated based on the coordinate value of the menu of the currently selected external device. If there is no menu of the previously selected external device, when the virtual control related image is executed, the menu ID of the external device is the smallest It can be set up so that a large one or an arbitrary one is selected.

FIG. 10 is a view showing a menu of an external device that does not support a remote controller in the display device according to another embodiment of the present invention. In comparison with FIG. 9, the transparency of the virtual control- There is a difference. In the case of FIG. 9, since the virtual control related image 700 covers a part of the screen, the user may feel inconvenience. Accordingly, as shown in FIG. 10, it is possible to reduce the inconvenience by allowing the virtual control related image 700 to be adjusted transparently or semi-transparently.

It is also within the scope of the present invention to adjust the transparency of the virtual control related image 700 through the remote controller 500 or another user interface 170.

Meanwhile, the display device 100 may operate in a bidirectional manner to transmit a user's request while being connected to an external device through an integrated interface. In addition, a remote controller 500 such as a remote controller for controlling the display device 100 may be provided together so that the service can be utilized well. This will be described with reference to FIGS. 11 and 12. FIG.

FIG. 11 is a view showing an external view of a remote controller for controlling a display device according to an embodiment of the present invention. Referring to FIG. 11, an external view of a remote controller for controlling a display device according to an embodiment of the present invention will be described Then,

First, as shown in FIG. 11A, it is exemplified that the pointer 501 corresponding to the remote controller 500 is displayed on the display device 100. FIG. Further, the display unit 190 shown in Fig. 11 corresponds to, for example, the display unit of the display device shown in Fig.

The user can move or rotate the remote controller 500 up and down, left and right (FIG. 11 (b)), and back and forth (FIG. 11 (c)). The pointer 501 displayed on the display unit 190 of the display device 100 corresponds to the movement of the remote controller 500. [ Such a remote controller 500 can be called a spatial remote controller so that the pointer 501 is moved and displayed in accordance with the movement in the 3D space, as shown in the figure.

11B illustrates that when the user moves the remote controller 500 to the outside, the pointer 501 displayed on the display unit 190 of the display device 100 moves to the left correspondingly.

Information on the motion of the remote controller 500 sensed through the sensor of the remote controller 500 is transmitted to the display device 100. [ The display device 100 can calculate the coordinates of the pointer 501 from the information on the motion of the remote controller 500. [ The display device 100 may display the pointer 501 so as to correspond to the calculated coordinates.

11C illustrates a case where the user moves the remote controller 500 away from the display unit 190 while the specific button in the remote controller 500 is depressed. Thereby, the selected area in the display unit 190 corresponding to the pointer 501 can be zoomed in and displayed. Conversely, when the user moves the remote controller 500 so as to approach the display unit 190, the selection area in the display unit 190 corresponding to the pointer 501 may be zoomed out and displayed.

Therefore, when the remote controller 500 shown in FIG. 11 is used, there is an effect that a menu or the like can be selected quickly and conveniently on the screen shown in FIG. 3 to FIG. 4 and FIG. 8 to FIG.

12 is a diagram showing a detailed configuration module of the remote controller shown in FIG. Hereinafter, a detailed configuration module of a remote controller according to an embodiment of the present invention will be described with reference to FIG.

12, the remote controller 500 includes, for example, a wireless communication unit 510, a user input unit 520, a sensor unit 530, an output unit 540, a storage unit 550, a power supply unit 560 and a control unit 570. The wireless communication unit 510 transmits and receives signals to and from the display device according to the above-described embodiment of the present invention.

In this embodiment, the remote controller 500 may include an RF module 511 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard. In addition, the remote controller 500 may include an IR module 513 capable of transmitting and receiving signals with the display device 100 according to the IR communication standard.

In this embodiment, the remote controller 500 transmits a signal containing information on the motion of the remote controller 500, etc., to the display device 100 through the RF module 511.

In addition, the remote controller 500 can receive the signal transmitted by the display device 100 through the RF module 511. [ The remote controller 500 can transmit commands to the display device 100 via the IR module 513 on power on / off, channel change, volume change, and the like, if necessary.

The user input unit 520 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the display device 100 to the remote controller 500 by operating the user input unit 520. [ In addition, the sensor unit 530 may include a gyro sensor 531 or an acceleration sensor 533.

For example, the gyro sensor 531 can sense information about the operation of the remote controller 500 on the basis of the x, y, and z axes. The acceleration sensor 533 can sense information on the moving speed of the remote controller 500 and the like. Meanwhile, a distance measuring sensor may be additionally provided, so that the distance to the display device 100 can be sensed.

The output unit 540 may output an image or voice signal corresponding to the operation of the user input unit 520 or corresponding to the signal transmitted from the display device 100. [ The user can recognize whether the user input unit 520 is operated or whether the display device 100 is controlled through the output unit 540.

For example, the output unit 540 includes an LED module 541 that is turned on when a user input unit 520 is operated or a signal is transmitted to and received from the display device 100 through the wireless communication unit 510, a vibration module 543 An audio output module 545 for outputting sound, or a display module 547 for outputting an image.

The storage unit 550 may store various types of programs, application data, and the like necessary for the control or operation of the remote controller 500. If the remote controller 500 wirelessly transmits and receives signals through the display device 100 and the RF module 511, the remote controller 500 and the display device 100 transmit and receive signals through a predetermined frequency band.

The power supply unit 560 supplies power to the remote controller 500. The power supply unit 560 can reduce power waste by interrupting the power supply when the remote controller 500 is not moving for a predetermined time. The power supply unit 560 can resume power supply when a predetermined key provided in the remote controller 500 is operated.

The control unit 570 controls various matters related to the control of the remote controller 500. The control unit 570 transmits a signal corresponding to a predetermined key operation of the user input unit 520 or a signal corresponding to the motion of the remote controller 500 sensed by the sensor unit 530 to the display device 100 ).

The control unit 570 controls the RF module 511 or the IR module 513 to input an input for selecting one of the menus of the external device displayed on the display unit 190 of the display device 100 Signal to the display device 100. [0031] As described above, since the command according to the motion of the remote controller 500 can be transmitted, there is a unique advantage of the present invention that it is possible to accurately select any one of the adjacent regions.

FIG. 13 is a diagram illustrating an entire system including a display device connected to an external display device according to another embodiment of the present invention through an integrated interface, and an embodiment of the present invention will be described in detail with reference to FIG. 13 .

2, the display device 100 can transmit a basic remote controller signal to an external device through the HDMI CEC in the case of an external device connected via HDMI as described above. However, when the external device is a computer such as a tablet PC or a notebook computer, there is a problem that the external device can not be controlled through the remote controller 500. [ This is because the external device often does not support the remote controller 500 of the display device 100.

Accordingly, another embodiment of the present invention provides an integrated interface that can be controlled through the remote controller 500 when the external device is a terminal device having a computer function, thereby solving the above problems.

According to another embodiment of the present invention shown in FIG. 13, the display device 100 is connected to a notebook 800 as an external device. At this time, the display device 100 receives an image from the notebook 800 and displays the image. 13, the web page executed through the web browser of the notebook PC 800 is displayed on the display unit 190 of the display device 100. In the example of Fig. At this time, upon receiving an input signal from the remote controller 500, the input signal is converted into information that can be processed by the notebook 800. By transmitting the converted information to the notebook 800, the effect of controlling the external device with the remote controller 500 of the display device 100 can be seen.

The information may include control data, and the control data may be a mouse event as data for controlling the external device. A mouse event occurs when a mouse moves, a mouse button is clicked, or a mouse wheel moves, and the external device can perform a program or a specific operation in response to a mouse event.

Accordingly, upon receiving an input signal from the user interface 170 via the remote controller 500, the controller 150 converts the input signal into a mouse event using the coordinate value of the input signal, And transmits the event to the external device.

13, the external device may be a tablet PC, a smart phone, or the like, and may be applied to all devices capable of displaying but also having a computer support function.

FIG. 14 is a block diagram of a virtual keyboard according to an exemplary embodiment of the present invention. Referring to FIG. 14, the controller 150 displays a virtual keyboard on the screen, The display unit 190 may be controlled so that the image 900 is displayed.

When a web page executed through the web browser of the external device is connected to the display device 100 and used, there is a case that specific contents are input on the web page. For example, if you are searching, you need to enter a keyword. If you want to log in to use other websites, you need to enter your ID and password. Accordingly, the controller 150 of the display device 100 displays a second image 900 indicating a virtual keyboard when the received input signal is a signal for a place where a keyboard input should be received.

In the second image 900 representing the virtual keyboard, the coordinate value for each key and the corresponding key value are stored in the memory 140. Accordingly, upon receiving a signal from the remote controller 500, the sensor 160 extracts a position value in the screen where an indicator that changes according to the movement of the signal is located. If the position value exists in the virtual keyboard area The key value corresponding to the position value is extracted. At this time, the indicator may be a pointer corresponding to the remote controller 500.

The controller 150 converts the signal into information that can be processed by the external device using the extracted key value, and transmits the converted information to the external device 800.

At this time, the information includes control data, and the control data may be a keyboard event as data for controlling the external device. The keyboard event occurs when a specific keyboard of the keyboard is pressed, and the external device can perform a program or a specific operation in response to a keyboard event.

FIG. 15 is a diagram illustrating another embodiment for displaying a virtual keyboard in the display device according to the present invention. Compared with FIG. 14, the embodiment according to FIG. 14 has a problem that a part of the image displayed on the display unit 190 is covered by the second image 900 displaying the virtual keyboard.

Accordingly, when the second image 900 displaying the virtual keyboard on the screen is displayed through the display unit 190, the controller 150 displays the image so that the image and the second image are displayed together Adjust the size or position. At this time, the controller 150 can use the basic data stored in the memory 140, for example, the resolution of the display device 100 and the resolution of the external device.

As shown in FIG. 15, by adjusting at least one of the size or position of the image displayed on the display unit 190, the problem that the second image 900 displaying the virtual keyboard hides some images of the screen There is an effect to solve. In addition, since the virtual keyboard can be selected only by a simple operation using the remote controller 500 and the external device can be controlled according to the selection, the convenience of the user is increased and the convenient function of the remote controller 500 can be maximized It is effective.

16 is a flowchart of a method of controlling a display device connected to at least one device according to an embodiment of the present invention through an integrated interface. Referring to FIG. 16, Will be described.

First, data indicating at least one function is received from an external device (S1100), and an image corresponding to each function is displayed using the received data (S1110). The images corresponding to the respective functions are described above.

Upon receiving a signal for selecting a particular image among the images corresponding to the respective functions from the remote controller (S1120), the position of the received signal is detected on the screen (S1130). At this time, at least one of the screen resolution of the display device, the resolution of the external device, the number of data indicating the function of the external device, the coordinate value at which the image corresponding to each function is located in the screen, .

It is also within the scope of the present invention to receive and sense a signal input through a button provided on a display device other than the remote controller, a user's touch, or the like.

Information corresponding to the sensed position value is extracted from the memory using the sensed position value (S1140), and the extracted information is transmitted to the external device (S1150). In this case, the information may include control data, and the control data may be an instruction code that can directly control an external device as described above. The control data may be an instruction code for a menu of the converted external device May be an identification code.

FIG. 17 is a flowchart showing a data transfer protocol between the remote controller, the display device, and the external device according to the method of FIG. 16, and describes a data transfer protocol between the remote controller, the display device, and the external device. However, the same points as those described in the method of Fig. 16 will not be described in detail.

The display device receives data indicating at least one function from the external device (S1200). Using the received data, an image corresponding to each function is displayed (S1210).

However, when the external device does not support the remote controller of the display device, there is a problem that the menu of the external device can not be selected using the remote controller.

In order to solve such a problem, a virtual control related image selectable by the remote controller can be displayed so that the remote controller can select a menu of the external apparatus. The user can select the virtual control related image, so that the menu of the external device has the selected effect, so that the external device can be controlled by the remote controller even when the external device does not support the remote controller of the display device. The virtual control related image has been described in detail with reference to FIG. 9 and FIG. 10, so a detailed description thereof will be omitted.

The display device receives a signal for the virtual control related image from the remote controller through the receiving module (S1230). The display device senses the position value in the screen of the received signal (S1240). At this time, as described above, after the position value of the virtual control related image is sensed, the menu of the external apparatus corresponding to the position value senses the position value positioned on the screen.

It is necessary to convert the detected position value into data that can be processed by an external device. Accordingly, information corresponding to the sensed position value is extracted by referring to the memory (S1250), and the information is converted into data that can be processed by the external device, and the information is transmitted to the external device (S1260).

18 is a flowchart of a method of controlling a display device connected to at least one device and an integrated interface according to another embodiment of the present invention. Referring to FIG. 18, A method of controlling the apparatus will be described.

Another embodiment of the present invention shown in Fig. 18 is a terminal device in which an external device is displayable and has a computer function, and is particularly easy when the size of the display portion is small.

First, an image received from an external device is displayed (S1300). The image may be a video signal, a data signal, or the like processed by the controller of the display device, and may include data for displaying a menu of the external device.

An input signal is received from the remote controller (S1310). It is also within the scope of the present invention to receive an input signal through means other than the remote controller as described above.

In order to detect the position value in the screen with respect to the input signal, a coordinate value in the display unit is extracted (S1320). The key value is extracted according to the coordinate value (S1330). The detected result is converted into data that can be processed by the external device (S1340), and the converted data is transmitted to the external device (S1350).

The converted data may be control data, and may include a keyboard event or a mouse event for controlling an external device. In the case of an external device such as a notebook computer, a tablet PC, or a smart phone, a program or a specific operation is performed in response to a keyboard event or a mouse event, so that an external device can be easily and simply controlled with only a remote controller.

Fig. 19 is a flowchart showing a data transmission protocol between the remote controller, the display device, and the external device according to the method of Fig. 18, and describes a data transfer protocol between the remote controller, the display device, and the external device.

The display device receives the image from the external device (S1400), and displays the received image (S1410).

Accordingly, the display apparatus receives an input signal for controlling the image from the remote controller (S1420). At this time, if it is determined that an indicator that changes according to the movement of the input signal is located in a specific area within the screen, that is, it is necessary to input additional characters, the display device displays a virtual keyboard And displays the image (S1430).

However, the image on the screen may be obscured by the second image representing the virtual keyboard. Accordingly, it is possible to adjust at least one of the size or the position of the image using the resolution of the external device and the display device so that the image is displayed together with the second image.

When the size or position of the image is adjusted, the display device receives an input signal to the virtual keyboard from the remote controller (S1440). If the remote controller is provided with a key input button separately, it recognizes that the key input signal of the virtual keyboard corresponding to the key input signal has been received, and displays it on the display unit (for example, A key pressed display, and only a specific key is displayed in a shaded manner).

Further, even when the remote controller does not have a separate key input button, it is recognized that the input signal is received with respect to the key of the virtual keyboard indicated by the pointer corresponding to the remote controller, and displayed on the display unit so that the user can recognize .

In operation S1450, a position value in the screen, that is, a coordinate value and a key value corresponding to the coordinate, are extracted from the input signal, and the input signal is converted into data that can be processed by an external device using the extracted result in operation S1460. The converted data includes a keyboard event. If the converted data is transmitted to the external device (S1470), the external device operates according to the converted data (S1480).

Furthermore, although the drawings are shown for convenience of explanation, it is also possible to design a new embodiment to be implemented by merging the embodiments described in each drawing. It is also within the scope of the present invention to design a computer-readable recording medium in which a program for executing the previously described embodiments is recorded according to the needs of those skilled in the art.

The display device and the control method thereof connected to the at least one device according to the present invention through the integrated interface are not limited to the configuration and method of the embodiments described above, All or some of the embodiments may be selectively combined.

Meanwhile, a method of controlling a display device connected to at least one device of the present invention through an integrated interface can be implemented as a code that can be read by a processor in a recording medium readable by a processor included in the display device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

In this specification, both the invention and the invention of the method are explained, and the description of the two inventions can be supplementarily applied as necessary.

100 display device 105 broadcast receiver
110 tuner 120 demodulator
130 network interface 140 memory
150 controller 160 sensor
170 User Interface 180 External Device Interface
190 Display unit 500 remote controller

Claims (13)

An external device interface for receiving data indicative of at least one function from an external device;
A display unit displaying an image corresponding to each function using the received data and displaying a virtual control related image;
A receiving module for receiving a signal from a remote controller;
A sensor for sensing an in-screen position value of the received signal; And
Determining whether the received signal is a signal for the external device or a signal for the display device by using the sensed position value and outputting information corresponding to the sensed position value when the signal is for the external device And a controller for extracting from the memory,
Wherein the controller determines that the received signal is a signal for an external device upon receiving a signal for selecting a specific image from the displayed image or a signal for selecting the virtual control related image,
Wherein the external device interface is connected to at least one device that transmits the information to the external device. delete The method according to claim 1,
The virtual control-related image includes:
Wherein the display device is connected by an integrated interface with at least one device including an image for up, down, left, and right four directional keys. The method according to claim 1,
The sensor includes:
A position of the image corresponding to each function in the screen, and data on the size of the image, the resolution of the screen, the resolution of the external device, the number of data indicating the function of the external device, A display device coupled to the at least one device and the integrated interface for sensing a value. The method according to claim 1,
The memory comprising:
The display device being connected to at least one device and an integrated interface for storing the information corresponding to the position value in the form of a table. The method according to claim 1,
The information corresponding to the position value may be,
Wherein the display device is connected to at least one device by an integrated interface, wherein the display device corresponds to a command code for controlling the external device. The method according to claim 1,
The controller comprising:
And at least one integrated interface for controlling the display unit to display a second image displaying a virtual keyboard on the screen according to a signal received through the receiving module. 8. The method of claim 7,
The controller comprising:
When the display unit displays a second image representing the virtual keyboard,
And at least one integrated interface that adjusts at least one of a size or a position of the image such that both the image and the second image are displayed. Displaying an image received from an external device;
Receiving an input signal for controlling the image from a remote controller;
Extracting a position value in a screen where an indicator that changes according to the movement of the input signal is located; And
Converting a keyboard event or a mouse event into the received input signal according to the position value; And
And transmitting the converted keyboard event or mouse event to the external device. The method of claim 1, further comprising: delete delete 10. The method of claim 9,
Wherein the converting comprises:
Displaying a second image representing a virtual keyboard when the indicator is located in a specific area within the screen; And
And adjusting the size of the image so that the image and the second image are displayed simultaneously. ≪ Desc / Clms Page number 20 > A computer-readable recording medium having recorded thereon a program for executing the method of claim 9.

Images