KR101013141B1 - Display system and control method thereof - Google Patents

Abstract

The present invention relates to a display system and a control method thereof. The display system according to the present invention includes a signal transmission unit for transmitting data, an image pickup unit for capturing an image, a user operator unit for receiving a control command from a user, and A remote control device including a remote control unit configured to calculate position information of a predetermined pointing device based on the captured image and to transmit the calculated position information through the signal transmitter; And a remote control signal receiver for receiving a signal from the remote control device, a UI generator for generating a UI menu, an image signal processor for processing the received image and the UI menu; And a display module having a display module for displaying the image and the UI menu, and a display control unit for controlling movement and function of a cursor displayed on the UI menu based on position information transmitted from the remote control apparatus. Thus, navigation and ease of access are made in the execution of menus and functions in the display system.

Description

DISPLAY SYSTEM AND CONTROL METHOD THEREOF}

1 is a schematic diagram of a display system according to a first embodiment of the present invention;

2 is a control block diagram of a remote control apparatus according to a first embodiment of the present invention;

3 is a schematic diagram of coordinate recognition of a remote control apparatus according to a first embodiment of the present invention;

4 is a control block diagram of a display device according to a first embodiment of the present invention;

5 is an example of a projection menu pad according to a second embodiment of the present invention;

6 is a control flowchart of a display system according to a second embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

10: remote control device 11: signal transmitter

13: Image capturing unit 15: User control unit

17: remote control control unit 18: RAM

19 processor 20 display device

21: Image receiver 22: Image signal processor

23: display unit 24: memory

25: remote control signal receiving unit 26: display control unit

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display system and a control method thereof, and more particularly, to a display system having a module for image capturing in a remote control device and a control method thereof.

In the conventional display system, the user's input is generally operated by operating a button provided on the panel of the main body casing of the display device, or mainly using a remote controller.

In such a conventional display system, a user selects a desired function by pressing a button of a remote control device. For example, when a channel switch and volume control button is pressed, a code corresponding to the button is transmitted from the remote control device to a display device. The code is interpreted by the display device and channel switching and volume control are performed in response to the code.

However, with the development of technology, functions provided by the display system are diversified, and since the size of the remote control device is limited to match these functions 1: 1 with the buttons of the remote control device, most functions are recently displayed. There is a situation in which a user selects and enters a UI menu provided by a device.

However, in order to set and select a desired function through the UI menu, the user has to enter various stages of the UI menu, and thus its operation is inconvenient with the existing remote control apparatus. Therefore, in recent years, it is possible to conveniently select a menu using a mouse, a space mouse, a touch pad, etc. In this case, it may be inconvenient to use several types of user input devices at the same time.

Accordingly, it is an object of the present invention to provide a display system and a method of controlling the same, which are easy to navigate and easily accessible in executing menus and functions by providing coordinate data without using other input devices such as a mouse.

According to the present invention, the above object is based on a signal transmission unit for transmitting data, an image pickup unit for capturing an image, a user operator unit for receiving a control command from a user, and the captured image. A remote control device including a remote control unit configured to calculate position information of a predetermined pointing device and to transmit the calculated position information through the signal transmitter; And a remote control signal receiver for receiving a signal from the remote control device, a UI generator for generating a UI menu, an image signal processor for processing the received image and the UI menu; And a display module having a display module for displaying the image and the UI menu, and a display control unit for controlling movement and function of a cursor displayed on the UI menu based on position information transmitted from the remote control apparatus. Can be achieved by a display system.

Meanwhile, an object of the present invention is to provide a display system, comprising: a projection menu pad on which menu items relating to at least one function are displayed; Calculating position information of a predetermined pointing device on the menu pad based on a signal transmitter for transmitting data, an image pickup unit for imaging the menu pad, a user operation unit for receiving a control command from a user, and the captured image And a remote controller to control the calculated position information to be transmitted through the first signal transmitter; And a remote control signal receiver for receiving a signal from the remote control device, and an image signal processor for processing the received image. A display module for displaying the image, a memory in which information on the menu pad is stored, a menu item of the menu pad corresponding to position information transmitted from the remote control apparatus from the memory, and a function corresponding to the menu item It can also be achieved by a display system comprising a display device having a display control unit for controlling to be executed.

The image capturing unit may be attached to a side of the main body of the remote control apparatus.

In addition, the menu pad displays predetermined identification information; The remote controller to transmit the identification information together with the location information to the display apparatus; The display controller may identify a menu item corresponding to the location information from information on a menu pad corresponding to the identification information from the memory.

On the other hand, it is an object of the present invention, in the control method of a display system including a remote control device and a display device, pointing the desired menu item on the projection menu pad on which the predetermined identification information and at least one function menu item is displayed. Step of doing; Imaging the menu pad; Checking the identification information from the captured image and calculating position information of the pointing on the menu pad; Transmitting the calculated position information and the identified identification information to the display apparatus; Receiving the identification information and the location information; Checking information on a menu pad corresponding to the identification information; Identifying a menu item corresponding to the location information from the identified information about the menu pad; It can be achieved by the control method of the display system comprising the step of executing a function corresponding to the identified menu item.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the present invention.

1 is a schematic diagram of a display system according to a first embodiment of the present invention. As shown in FIG. 1, the display system according to the first embodiment of the present invention is provided with a remote control device 10 that receives and outputs a user's control command, and according to a control command transmitted from the remote control device 10. It includes a display device 20 for performing a function.

A detailed description of the remote control device 10 will be described with reference to FIGS. 2 and 3. 2 is a control block diagram of a remote control apparatus 10 according to a first embodiment of the present invention, and FIG. 3 is a schematic diagram of coordinate recognition of the remote control apparatus 10 according to the first embodiment of the present invention. .

As shown in FIG. 2, the remote control apparatus 10 according to the first embodiment of the present invention includes a signal transmitter 11, an image capture unit 13, a user operator 15, a remote controller 17, and a RAM. 18 and a processor 19.

The signal transmitter 11 is for communication with the display apparatus 20, and an infrared communication module, a Bluetooth communication module, or an RF (radio frequency) communication module may be used. For example, when using an infrared communication module, infrared pulses are transmitted using an infrared light emitting diode (LED) light emitting device.

The image capturing unit 13 is for capturing an image and may be located on the side of the main body of the remote control apparatus 10. More detailed description of the image capturing unit 13 will be described with reference to FIG. 3.

As shown in FIG. 3, it is located on the side of the remote control apparatus 10 to capture the movement of the user's finger. Although the user's finger is shown in FIG. 3, a pointing device such as a ballpoint pen may be used. Hereinafter, all of these will be referred to as pointing devices.

The image capturing unit 13 may include a lens (not shown), an aperture (not shown), and an image sensor (not shown). As the lens, a general small lens may be used, the aperture is used to adjust the amount of light and the depth of field, and the image sensor may be a CMOS sensor having a low resolution of a matrix type generally used in an optical mouse. However, if necessary, a high resolution image sensor may be used. As shown in Fig. 3, in order to recognize the coordinates, the projected adjacent projection area is defined and imaged. In addition, it can be used regardless of the material of the bottom surface.

The user control unit 15 is for receiving a user's control command, and is composed of a plurality of buttons located on the upper side of the main body of the remote control apparatus 10, and includes a TV function of various display apparatuses 20. It contains a number of function buttons for controlling functions.

In addition, the user operator 15 may include a selection button for activating the pointing function. The pointing function refers to the activation of the image capturing unit 13 and the coordinate calculation function of the controller to be described later.

When the input of the user operator 15 occurs, the remote controller 17 according to an embodiment of the present invention performs a function corresponding thereto or generates a corresponding remote control signal and transmits it through the signal transmitter 11. The RAM 18 includes a random access memory (RAM) and a processor 19 which is in charge of operation and control.

In particular, when the pointing function is activated, the remote controller 17 controls the image capturing unit 13 to be activated, and periodically analyzes the captured image provided from the image capturing unit 13 to determine the motion data of the pointing device. X, Y coordinate or relative motion value) is calculated and transmitted to the external display device 20 through the signal transmitter 11.

That is, when the user moves the pointing device at the side of the remote control apparatus 10 as shown in FIG. 3, the image of the side captured from the image capturing unit 13 located at the side is changed, so that the processor 19 immediately before The magnitude of the motion of the pointing device is calculated by analyzing the motion of the captured image and the current image. Here, the motion data is calculated by comparing and matching the previously captured image with the currently captured image, and various methods such as a block matching algorithm may be applied.

The processor 19 according to an exemplary embodiment of the present invention may calculate a moving direction and a moving distance by using a relative coordinate method, that is, a relative coordinate system, or may calculate motion data according to an absolute coordinate system.

In addition, the equation may be mathematically changed by the angle of the image sensor or the curved surface of the lens. In the case of simple mapping, the distance changes more closely in the projected space when converted to real space, and in the case of near mapping, it is mapped in reverse. Since this coordinate calculation method is already known to those skilled in the art, a detailed description thereof will be omitted.

Hereinafter, the display apparatus 20 will be described with reference to FIG. 4. 4 is a control block diagram of the display apparatus 20 according to the first embodiment of the present invention.

As shown in FIG. 4, the display apparatus 20 according to the first embodiment of the present invention includes an image receiver 21, an image signal processor 22, a display unit 23, a remote control signal receiver 25, and And a display control unit 26.

The image receiver 21 receives a broadcast signal or a video signal from an external source. The image receiver 21 may include an antenna for receiving a broadcast signal and a tuner for tuning a broadcast channel, and may include an input terminal such as a connection cable connected to an external source. For example, it may include input terminals such as S-video, Component, PC-signal, DVI-signal, and HDMI corresponding to various external sources.

The image signal processor 22 converts a signal input through image reception into a signal in a format that the display unit 23 can display and processes.

The video signal processor 22 converts a CVBS (Composite Video Broadcast Signal) signal or an S-Video signal to a decoder, an A / D converter for converting an analog signal that is a component signal or a PC-signal into a digital signal, and a DVI-signal R. It may include a TMDS (Transition Minimized Differential Signaling) receiver that separates the G, B digital signals and the H / V signals. In addition, the image signal processing unit 22 includes a scaler for converting the image signal into a vertical frequency, a resolution, an aspect ratio, and the like in accordance with the output standard of the display unit 23. The display unit 23 includes a display panel for displaying an image and a panel driver for controlling driving of the display panel. According to an embodiment of the present invention, the display units 23, 130, and 30 may be of various types, such as a cathode ray tube (CRT), a digital light processing (DLP), a liquid crystal display (LCD), a plasma display penal (PDP), or the like. Display module is applicable.

The remote control signal receiver 25 receives a remote control signal transmitted from the remote control device 10, and corresponds to an infrared communication module, a Bluetooth communication module, or an RF communication in response to the signal transmitter 11 of the remote control device 10. Modules and the like can be used.

The display controller 26 is responsible for the overall control of the display apparatus 20 to perform an operation corresponding to the remote control signal received from the remote controller 10, and may be implemented by a controller such as a microcomputer.

For example, when a channel switching command is received from the remote control device 10, the tuner controls the tuner to tune a frequency corresponding to the corresponding channel, and when a control signal related to a pointing function is received, the pointing cursor is moved according to the corresponding coordinate value. Or control to perform the operation.

In addition, the display controller 26 may include a UI generator for generating UI menu data, and the generated UI menu data is combined with the image signal currently processed by the scaler of the image signal processor 22 to display the display unit 23. ) Is displayed.

For example, when the user operates the user control unit 15 of the remote control device 10 and the UI menu display function is selected, the remote control device 10 transmits the corresponding control code to the display device 20 and displays the display. The device 20 interprets the control code and generates and displays a UI menu corresponding to the control code.

Then, when the user activates the pointing function of the remote control apparatus 10 and moves the pointing device, the remote control apparatus 10 captures an image and calculates the movement of the pointing device to transfer the corresponding coordinate data to the display apparatus 20. send.

The display apparatus 20 moves the cursor displayed on the UI menu or performs a corresponding function based on the coordinate data transmitted from the remote control apparatus 10.

Hereinafter, a display system according to a second embodiment of the present invention will be described with reference to FIGS. 1 to 6. In the display system according to the second embodiment of the present invention, the same reference numerals are used for the same components as those of the above-described embodiment, and redundant descriptions will be omitted as necessary.

5 is an example of the projection menu pad according to the second embodiment of the present invention.

In the second embodiment of the present invention, the desired function is selected using the projection menu pad as shown in FIG. Projection menu pads can be printed on paper or plastic, and can be made by the consumer in software, or replaced by remote control labels with new features and combinations, enclosed by the manufacturer on the Internet, email, mail and new product distribution.

The user places the projection menu pad in the imaging area of the remote controller shown in FIG. 3 and selects a desired menu item using a pointing device.

Here, the projection menu pad includes identification information. The identification information is information for identifying the type of menu pad or information that may be a reference position of coordinate recognition of the menu pad. The memory 24 may store information about a plurality of menu pads, and the corresponding menu pads may be known through identification information. As shown in FIG. 5, the identification information may be displayed in a bar code format, and the remote controller 17 may calculate the identification information and the movement data of the pointing device from the captured image and display the identification information and the position information on the display apparatus 20. Will be sent).

As shown in FIG. 4, the display apparatus 20 according to the second embodiment of the present invention may further include a memory 24, and the memory 24 stores information about a menu pad. That is, information about the type of menu pad used by the user and the position coordinates of each menu item on the menu pad is stored, and when identification information and position information are received from the remote control apparatus 10, Check the menu item corresponding to the location information in the information. Then, the function is performed according to the confirmed menu item.

A control flow of the display system according to the second embodiment of the present invention will be described with reference to FIG. 6. 6 is a control flowchart of a display system according to a second embodiment of the present invention.

As described above, when the pointing function is selected through the user operator 15, the imaging mode is activated (S10). At this time, the user points a desired menu item on the projection menu pad using a pointing device such as a finger (S11).

The image capturing unit 13 continuously captures an image at predetermined time intervals (S12). The remote controller 17 checks the identification information from the captured image and calculates the location information of the pointing device (S13).

Then, the calculated position information and identification information are transmitted to the display apparatus 20 through the signal transmitter 11 (S14).

The display apparatus 20 receives the identification information and the position information transmitted from the remote control apparatus 10 (S15), and checks the information on the menu pad corresponding to the identification information from the memory 24 (S16). Then, the menu item corresponding to the location information is checked from the information on the confirmed menu pad (S17).

Then, to perform a function corresponding to the confirmed menu item (S18).

For example, when the user indicates the item "DVD" on the menu pad shown in FIG. 5, the remote control apparatus 10 calculates coordinates corresponding to the pointing position and displays the display apparatus 20 together with the identification information of the menu pad. To send. The display apparatus 20 checks the type of the menu pad through the identification information, and checks the menu item corresponding to the location information on the menu pad. As a result, the display apparatus 20 performs a function of "DVD" which is a menu item corresponding to the location information.

Therefore, according to the user's frequency of use, functions that are frequently used can be reconfigured and selected by the menu pad, thereby reducing the depth of search and improving accessibility.

Although some embodiments of the invention have been shown and described, it will be apparent to those skilled in the art that modifications may be made to the embodiment without departing from the spirit or spirit of the invention. . It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents.

As described above, according to the present invention, there is provided a display system and a method of controlling the same, which are easy to navigate and easily accessible in executing menus and functions by providing coordinate data without using other input devices such as a mouse.

Claims (5)

In a display system, A signal transmitter for transmitting data, an image pickup unit for capturing an image, a user operator for receiving a control command from a user, and a position information of a predetermined pointing device are calculated based on the captured image, and the calculated position is calculated. A remote control device including a remote control control unit for controlling information to be transmitted through the signal transmission unit; And A remote control signal receiver for receiving a signal from the remote control device, a UI generator for generating a UI menu, an image signal processor for processing the received image and the UI menu; And a display module having a display module for displaying the image and the UI menu, and a display control unit for controlling movement and function of a cursor displayed on the UI menu based on position information transmitted from the remote control apparatus. Display system. In a display system, A projection menu pad on which menu items relating to at least one function are displayed; Calculating position information of a predetermined pointing device on the menu pad based on a signal transmitter for transmitting data, an image pickup unit for imaging the menu pad, a user operator for receiving a control command from a user, and the captured image And a remote controller controlling the remote control unit to transmit the calculated position information through the signal transmitter; And A remote control signal receiver for receiving a signal from the remote control device, and an image signal processor for processing the received image; A display module for displaying the image, a memory in which information on the menu pad is stored, a menu item of the menu pad corresponding to position information transmitted from the remote control apparatus from the memory, and a function corresponding to the menu item A display system comprising a display device having a display control unit for controlling to be executed. The method according to claim 1 or 2, And the image capturing unit is attached to a side surface of the main body of the remote control apparatus. The method according to claim 1 or 2, The menu pad is provided with predetermined identification information; The remote controller to transmit the identification information together with the location information to the display apparatus; And the display control unit confirms a menu item corresponding to the location information from information on a menu pad corresponding to the identification information from the memory. In the control method of a display system comprising a remote control device and a display device, Pointing a desired menu item on a projection menu pad on which predetermined identification information and menu items relating to at least one function are displayed; Imaging the menu pad; Checking the identification information from the captured image and calculating position information of the pointing on the menu pad; Transmitting the calculated position information and the identified identification information to the display apparatus; Receiving the identification information and the location information; Checking information on a menu pad corresponding to the identification information; Identifying a menu item corresponding to the location information from the identified information about the menu pad; And executing a function corresponding to the identified menu item.

Images