WO2008018652A1

WO2008018652A1 - Mouse equipped with remote pointing-type remote controller

Info

Publication number: WO2008018652A1
Application number: PCT/KR2006/004142
Authority: WO
Inventors: Hun Jung; Uk Jung Hwang
Original assignee: Goldenchips Co., Ltd
Priority date: 2006-08-08
Filing date: 2006-10-13
Publication date: 2008-02-14
Also published as: CN101122837A; KR100728796B1

Abstract

The mouse includes a remote controller selectively installed in or removed from an accommodation part by a user, the accommodation part being formed in one side of the mouse; a signal reception unit for receiving an infrared signal from the remote controller; an image reception unit for acquiring a background image during a first signal reception period, in which an infrared signal is not input from the remote controller, and acquiring an optical image, corresponding to the infrared signal received from the remote controller, during a second signal reception period, in which an infrared signal is input from the remote controller; an image processing unit for generating a corrected optical image based on a difference between the optical image and the background image; and a pointing amount calculation unit for calculating an amount of movement of the remote controller based on the optical image input from the image processing unit.

Description

MOUSE EQUIPPED WITH REMOTE POINTING-TYPE REMOTE CONTROLLER

Technical Field

The present invention relates generally to a mouse equipped with a remote pointing-type remote controller and, more particularly, to a mouse equipped with a remote pointing-type remote controller, in which an accommodation part is formed in one side of the mouse, and which is capable of controlling a device connected to the mouse through the reception unit of the mouse, using the remote controller, which is selectively installed in or removed from the accommodation part by a user, based on a remote pointing technique.

Background Art

In modern society, remote controllers used for a digital Television (TV) , a Video Tape Recorder (VTR) , a

Digital Versatile Disk (DVD) player, a set-top box, a

Personal Computer (PC), etc., the size of which becomes large, are based on one of the remote control technologies that use infrared rays. Remote controllers can control the selection of the various menus of a device, such as the selection of channels or the control of volume, through key input based on a user' s manipulation, and have made our lives very convenient. Typical remote controllers using a conventional infrared scheme have been widely used as remote controllers indispensable for our lives so far. In order to control information devices equipped with electronic displays, such as digital TVs, VTRs and audio devices, which are becoming more complicated day by day, using the conventional remote controllers, a manipulation sequence or method for moving from a main menu to a lower-level sub-menu and selecting a target menu item is very complex, and many manipulation buttons must be pressed to the extent that the number of key inputs is usually 4 to 5 or more. Accordingly, the remote control is troublesome and complex, so that the use thereof is inconvenient.

Due to these problems, there has been an urgent need for a remote control technology that can control information devices in a diversified and convenient Graphic User Interface (GUI) fashion, such as the menu system of Windows on a PC. A correspondingly proposed technology is a remote controller to which a remote pointing device is applied. The remote pointing device can be implemented in GUI form using an image sensor. In view of the fact that the application fields of remote pointing systems using such remote pointing devices include digital TVs, audio devices, display devices, game machines, etc., the remote pointing devices have been used in many various environments .

Unlike what has been described above, in the case of PCs, mouses have been used as indispensable input devices for controlling a variety of operating systems, such as the Windows operating system, as they have been applied to the PCs . Mouses can be implemented in GUI form, and enable a direct instruction system, in which, when a user points a pointer (mouse pointer) at a corresponding portion when freely moving the mouse pointer across a screen, a function corresponding to the portion is immediately performed. However, the remote controllers and the mouses based on the proposed technologies are convenient for the control of devices, but have a disadvantage in that many limitations are accompanied due to the narrow working ranges thereof.

For example, in the case of computers, movie viewing and program control are basically controlled using mouses that are manipulated by users. However, a problem arises in that the computers must be additionally equipped with remote controllers and receiving devices, which enable the implementation of remote pointing, in order to perform short-range control.

Disclosure of the Invention

Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and an object of the present invention is to provide a mouse equipped with a remote pointing-type remote controller, in which the remote controller is provided in an accommodation part formed in one side of the mouse, and the mouse is provided with a signal reception unit, an image reception unit, an image processing unit and a pointing amount calculation unit so as to implement remote pointing-type control using the remote controller, so that the remote controller is separated from the mouse at the time of requiring manipulation over a short distance during the manipulation of a device using the mouse, and performs remote pointing-type control. Another object of the present invention is to provide a mouse equipped with a remote pointing-type remote controller, in which an accommodation part for accommodating the remote controller and the remote controller are provided with respective connectors, and the remote controller is charged with electricity when it is combined with the accommodation part, so that the supply of power can be achieved without using a separately provided charger or battery.

In order to accomplish the above objects, the present invention provides a mouse equipped with a remote pointing- type remote controller, including a remote controller selectively installed in or removed from an accommodation part by a user, the accommodation part being formed in one side of the mouse; a signal reception unit for receiving an infrared signal from the remote controller; an image reception unit for acquiring a background image during a first signal reception period, in which an infrared signal is not input from the remote controller, and acquiring an optical image, corresponding to the infrared signal received from the remote controller, during a second signal reception period, in which an infrared signal is input from the remote controller; an image processing unit for generating a corrected optical image based on a difference between the optical image and the background image; and a pointing amount calculation unit for calculating an amount of movement of the remote controller based on the optical image input from the image processing unit.

According to a preferred feature of the present invention, the accommodation part and the remote controller are provided with respective connectors, so that the remote controller is supplied with power when accommodated in the accommodation part through a connection between the connectors .

According to a preferred feature of the present invention, the connectors of the accommodation part and the remote controller are formed of USB ports . According to a preferred feature of the present invention, the image reception unit includes an image sensor for acquiring the background image in the first signal reception period and the optical image in the second signal reception period; and a lens set disposed in front of the image sensor to receive only a signal in a specific band, which is selected from within the infrared signal received from the remote controller. According to a preferred feature of the present invention, the remote controller is switched to a remote pointing mode when the user manipulates a mode selection button, and starts remote pointing control.

Brief Description of the Drawings

FIG. 1 is a perspective view showing a mouse according to the present invention;

FIG. 2 is a view showing a remote controller according to the present invention; FIG. 3a is a view showing a method of combining the mouse and the remote controller according to an embodiment of the present invention;

FIG. 3b is a view showing a method of combining the mouse and the remote controller according to another embodiment of the present invention;

FIG. 4 is a block diagram of the mouse according to the present invention;

FIG. 5 is a block diagram of the remote controller according to the present invention; FIG. 6 is a view showing images depending on the optical structure of an image reception unit and the distance to the remote controller according to the present invention; and

FIG. 7 is a conceptual diagram showing a state in which the mouse equipped with the remote pointing-type remote controller according to an embodiment of the present invention is employed.

Best Mode for Carrying Out the Invention

Embodiments of a mouse equipped with a remote pointing-type remote controller according to the present invention will be described in detail with reference to the accompanying drawings .

FIG. 1 is a perspective view showing a mouse according to the present invention. FIG. 2 is a view showing a remote controller according to the present invention. FIG. 3a is a view showing a method of combining the mouse and the remote controller according to an embodiment of the present invention. FIG. 3b is a view showing a method of combining the mouse and the remote controller according to another embodiment of the present invention. FIG. 4 is a block diagram of the mouse according to the present invention.

FIG. 5 is a block diagram of the remote controller according to the present invention. FIG. 6 is a view showing images depending on the optical structure of an image reception unit and the distance to the remote controller according to the present invention. FIG. 7 is a conceptual diagram showing a state in which the mouse equipped with the remote pointing-type remote controller according to an embodiment of the present invention is employed.

The mouse equipped with the remote pointing-type remote controller according to the present invention includes a remote controller 200 configured to be selectively installed in or removed from an accommodation part 110, formed in one lateral side of a mouse 100, through a user's manipulation, a signal reception unit 120 for receiving infrared signals generated from the remote controller 200, an image reception unit 130 for acquiring a background image while no infrared signal is input to the signal reception unit 120, and acquiring an optical image corresponding to an infrared signal received from the remote controller when the infrared signal is input to the signal reception unit 120, an image processing unit 140 for generating a corrected optical image based on the difference between the optical image and the background image, and a pointing amount calculation unit 150 for calculating the amount of movement of the remote controller 200. Detailed descriptions thereof will be given below. The principal technical gist of the mouse equipped with the remote pointing-type remote controller according to the present invention is that the mouse is provided with the remote controller to which a remote pointing technique is applied. The mouse 100 is one of the input devices that are used by users to control digital devices, such as a computer and a digital TV, and is coupled to a device via a wireless or wired connection.

In the case of the wireless connection, the mouse 100 must be additionally provided with a reception device, whereas, in the case of the wired connection, the mouse 100 is connected via a connection port 103. The mouse 100 can freely move a pointer (a mouse pointer) on a screen under the control of a control unit 102 based on the amount of movement, which is calculated by a mouse sensor 101, such as an optical sensor or a sensor for calculating the amount of movement of a rotating ball, as the mouse 100 is moved by the manipulation of a user, and can then run a program or control a device.

As shown in FIG. 1 or 3a, the mouse 100 is provided with the inwardly formed accommodation part 110 in one side thereof so as to accommodate the remote controller 200, therefore a user can selectively install or remove the remote controller 200 in or from the mouse. Although, in an embodiment of the present invention, the accommodation part 110 has been described as being formed in one lateral side of the mouse 100, the accommodation part 110 may be formed in various ways depending on the size of the internal space based on the structural shape of a mouse, such as in the left, right or upper side of the mouse.

In an alternative embodiment, a remote controller 200 may be provided on the top of a mouse in a detachable manner, as shown in FIG. 3b. In this case, the button unit of the mouse may also be integrated with the remote controller 200 and be selectively installed in or removed from the accommodation part 110.

Meanwhile, a connector 120, which can supply power when the remote controller 200 is combined with the mouse, is further provided on one side of the accommodation part 110. Although it is preferable to use a Universal Serial Bus (USB) connector, which is generally used when connecting a PC with a peripheral device, as the connector 160, the connector 160 is not limited to the USB connector, rather, it is possible to employ various connectors that can supply power.

The present invention for implementing the remote pointing system using the remote controller 200 provided in the mouse 100 is configured such that the signal reception unit 120, the image reception unit 130, the image processing unit 140 and the pointing amount calculation unit 150 are further included in the mouse 100.

The principle of the remote pointing method is described in detail below. The signal reception unit 120 outputs a control signal that makes a command such that operation be performed in a mode corresponding to an infrared signal from the remote controller 200, the mode being one of a remote control mode, in which a control command corresponding to an infrared signal received from the remote controller 200 is executed, and a remote pointing mode, in which the amount of variation in the location of a pointing point is calculated based on an infrared signal from the remote controller 200a, and then a remote pointing operation is performed.

When a control signal, commanding operation to be performed in a remote pointing mode, is received from the signal reception unit 120, the image reception unit 130 is operated and is switched from a standby state to an operation state. The image reception unit 130 that has switched to an operation state acquires a background image during a first signal reception period, in which infrared signals are not input from the remote controller 200, and acquires an optical image, corresponding to an infrared signal received from the remote controller 200, during a second signal reception period, in which infrared signals are input from the remote controller 200.

The image reception unit 130 includes an image sensor 132, configured to acquire a background image in the first signal reception period and an optical image in the second signal reception period, and a lens set 131 provided in front of the image sensor 132 and configured to receive only a signal in a specific band that is selected from within an infrared signal received from the remote controller 200.

As shown in FIG. 6, the remote controller 200 can be represented as the infrared light source 1000 of the remote controller 200, located at a distance Di from the lens set 131, and the infrared light source 1100 of the remote controller 200, located at a distance Do from the lens set 131, according to the distance to the lens set 131. The distance between the lens set 131 and the image sensor 132 is significantly shorter than the distance between the lens set 131 and the light source 1000 or 1100 of the remote controller 200. Accordingly, the distance between the lens set 131 and the light source 1000 or 1100 of the remote controller 200 does not greatly differ from the distance calculated based on the distance between the image sensor 132 and the light source of the remote controller 200.

The mouse equipped with the remote pointing-type remote controller according to the present invention uses image information that is obtained in such a way that the positional information of the remote controller 200 in three-dimensional space is projected onto the two- dimensional (2-D) image sensor 132, included in the image reception unit 130, through the optical lens set 131 shown in FIG. 6. That is, the distance between the image sensor 132 and the light source is determined in a process of extracting 2-D pointing information projected onto the image sensor 132, and then the amount of actual movement of the light source in the upper/lower or left/right directions based on information about the distance. The amount of relative movement is then compensated for such that the results of remote pointing in the upper/lower or left/right directions of a screen, displayed based on the measured amount of movement of the remote controller 200, can be represented in a uniform manner regardless of the distance between the remote controller 200 and the image sensor 132.

In FIG. 6, the diameter R of the infrared light source 1000, located at the distance Di from the lens set 131, is positioned at a relatively remote location compared to that of the infrared light source 1100, located at the distance D₀ from the lens set 131, so that the size of the light source 1300 acquired by the image sensor 132 is relatively small due to the crossing optical structure of the lenses. Furthermore, the diameter R of the infrared light source 1100, located at the distance Do from the lens set 131, is positioned at a relatively close location compared to that of the light source 1000, located at the distance Di from the lens set 131, so that the size of a light source 1200 acquired by the image sensor 132 is relatively large due to the crossing optical structure of the lenses.

Therefore, the size of the infrared light source of an image acquired by the image sensor 132 at a location remote from the image sensor 132 is represented as being smaller than that of the infrared light source of an image acquired by the image sensor 132 at a location close to the image sensor 132. That is, the size of the infrared light source of an image acquired by the image sensor 132 at a location close to the image sensor 1000 is represented as being larger than that of the infrared light source of an image acquired by the image sensor 132 at a location remote from the image sensor 132.

The brightness (luminous intensity) of an infrared light source is characterized in that it decreases as the distance between the image sensor 132 and the infrared light source increases. Furthermore, it can be seen that, from the point of view of the image of a light source that is actually obtained by the image sensor 132, a large pointing value is output due to relatively bright infrared light at a close location, and a small pointing value is output due to relatively dark infrared light at a remote location, for the movement of the infrared light source of the actual remote controller 200 having the same physical amount . Therefore, a pointing value based on an image of a light source, simply acquired from the image sensor 132, cannot be directly used as a pointing value of an actual remote controller 200, but an actual pointing value must be calculated based on the relationship between the distances from the infrared light sources 1000 and 1100 to the optical lens set 131, and then be used.

The image processing unit 140 calculates the difference between the optical image and the background image, acquired by the image reception unit 130, and generates a corrected optical image by applying an image mask (morpheme) , that is, a conventional image processing technique, to an intermediate image created based on the calculated value. Thereafter, the image processing unit 140 measures the size and shape of the corrected optical image in lateral and vertical directions through the histogram analysis of the corrected optical image. The pointing amount calculation unit 150 calculates the distance to the remote controller 200 based on the size of the corrected optical image. The amount of movement of the remote controller 200 is calculated based on the calculated distance. At this time, the pointing amount calculation unit 150 calculates coordinate (X, Y and Z) values (a pointing value) , that is, the amount of movement of the remote controller 200 in a spatial coordinate system, in which the center of the image sensor 132, constituting part of the image reception unit 130, is used as the origin thereof.

The calculated pointing value is used to perform remote pointing by freely moving the pointer up/down and left/right on a screen under the control of the control unit 102. The remote controller 200 includes a manipulation button unit 210, a mode selection button 220, a light emission unit 230, a control unit 202, and a power source unit 201. The remote controller 200 is combined with the accommodation part 110 of the mouse 100 when it is not used, but is separated from the accommodation part 110 and is then used when a user desires to use the remote controller 200. The manipulation button unit 210 includes buttons necessary for the control of a device (a TV, an audio device, a set-top box, or the like) , such as numeric buttons, function selection buttons and menu buttons. The mode selection button 220 performs control so that switching is performed in a remote control mode, in which an infrared ray receiving device (the mouse 100 according to the present invention) executes a control command corresponding to an infrared signal received from the remote controller 220, and a remote pointing mode, in which the infrared ray receiving apparatus calculates the amount of movement of a pointer based on an infrared signal received from the remote controller 200, and performs a remote pointing operation. The mode selection button 220 is manipulated directly by a user when the user desires to use the remote pointing mode using the remote controller 200.

Since the operation of the remote controller 200 and the infrared ray receiving device when the remote control mode is selected is generally and widely known and does not pertain to the core technical spirit of the present invention, a description thereof will be omitted here.

The remote controller 200 further includes a connector 240. When the remote controller 200 is installed in the accommodation part 110, the connector 240 is connected to the connector 160 and charges the power source unit 201 of the remote controller 200 with electricity. The power source unit 201 is equipped with a rechargeable battery.

Generally, the remote controller 200 is equipped with a disposable battery, so that there is the inconvenience of replacing the battery after it is discharged upon use for some period. In contrast, in the present invention, a rechargeable battery is used as the power source of the remote controller 200, and it is charged through the connection between the connectors 240 and 160 while the remote controller 200 is combined with the accommodation part 110, when not in use, thus eliminating the inconvenience of replacing the battery.

An embodiment of the operation of the mouse equipped with the remote pointing-type remote controller according to the present invention is described below. In a device, such as a computer, connected to the mouse 100 according to the present invention, the selection of various menu items, program control, device control, etc. are performed by freely moving a pointer across a display using the mouse 100 manipulated by a user. At this time, the power source unit 201 of the remote controller 200 combined with the accommodation part 110 of the mouse 100 can be charged with electricity because the connector 160 and the connector 240 are connected to each other.

When a user desires to control a device over a short distance while controlling the device using the mouse 100 manipulated by the user, the user separates the remote controller 200 from the accommodation part 110, and starts remote pointing control by manipulating the mode selection button 220.

Then, the signal reception unit 120 receives an infrared signal from the remote controller 200, and switches the image reception unit 130 from a standby state to an operation state.

The image reception unit 130 acquires a background image during the first signal reception period, in which infrared signals are not input from the remote controller 200, and then acquires an optical image, corresponding to an infrared signal received from the remote controller 200, during the second signal reception period, in which infrared signals are input from the remote controller 200.

The image processing unit 130 calculates the difference value between the optical image and the background image, which are acquired by the image reception unit 120, and generates a corrected optical image by applying an image mask to an intermediate image created based on the calculated value. The image processing unit 130 then measures the size and shape of the corrected optical image in lateral and longitudinal directions through the histogram analysis of the corrected optical image .

The pointing amount calculation unit 150 calculates the distance to the remote controller 200 based on the size of the corrected optical image, and calculates the amount of movement of the remote controller 200 based on the distance. At this time, the coordinates X, Y and Z of the remote controller 200 in a spatial coordinate system, in which the center of the image sensor 132, constituting part of the image reception unit 130, is used as an origin, are calculated, and the calculated coordinate values are transmitted to the control unit 102 of the mouse 100. As a result, the pointer on the display can be controlled using the remote controller 100 in a manner similar to the use of a GUI environment through the movement of a mouse. The present invention, which is constructed and operated as described above, has an advantage in that it is very convenient because the mouse is equipped with the remote controller that uses the remote pointing technique, so that the remote controller can be separated from the mouse at the time of controlling a device over a short distance, and the pointer can be freely manipulated using the remote pointing technique.

Furthermore, when the remote controller is combined with the accommodation part of the mouse, the connectors respectively provided in the accommodation part and the remote controller are connected to each other, and then the power source unit of the remote controller is charged. Therefore, the inconvenience of replacing a battery due to the use of a typical disposable battery can be eliminated, and accordingly, higher convenience can be provided.

Meanwhile, the present invention is not limited to the above-described embodiments, and it is apparent to those skilled in the art that various modifications and variations are possible without departing from the scope and spirit of the invention.

Accordingly, it should be noted that those variations and modifications pertain to the claims of the present invention.

Industrial Applicability

The present invention, which is constructed and operated as described above, has an advantage in that the mouse is provided with the remote pointing-type remote controller, and the remote controller is separated from the mouse at the time of requiring short-distance manipulation during manipulation using the mouse, and the manipulation of a device, such as an information display device, including a digital TV, a set-top box, and VOD, is implemented using a remote pointing technique in a manner similar to the use of a GUI environment through the movement of a mouse, thereby enabling convenient manipulation and control of the device. Furthermore, the remote controller uses the rechargeable-type power source unit that is supplied and charged with power through the connectors when the remote controller is combined with the mouse. Accordingly, there is an advantage in that the inconvenience of replacing a battery due to the use of a disposable battery in a conventional remote controller is eliminated.

Claims

1. A mouse equipped with a remote pointing-type remote controller, comprising: a remote controller selectively installed in or removed from an accommodation part by a user, the accommodation part being formed in one side of the mouse; a signal reception unit for receiving an infrared signal from the remote controller; an image reception unit for acquiring a background image during a first signal reception period, in which an infrared signal is not input from the remote controller, and acquiring an optical image, corresponding to the infrared signal received from the remote controller, during a second signal reception period, in which an infrared signal is input from the remote controller; an image processing unit for generating a corrected optical image based on a difference between the optical image and the background image; and a pointing amount calculation unit for calculating an amount of movement of the remote controller based on the optical image input from the image processing unit.

2. The mouse as set forth in claim 1, wherein the accommodation part and the remote controller are provided with respective connectors, so that the remote controller is supplied with power when accommodated in the accommodation part through a connection between the connectors .

3. The mouse as set forth in claim 2, wherein the connectors of the accommodation part and the remote controller are formed of Universal Serial Bus (USB) ports.

4. The mouse as set forth in claim 1, wherein the image reception unit comprises : an image sensor for acquiring the background image in the first signal reception period and the optical image in the second signal reception period; and a lens set disposed in front of the image sensor to receive only a signal in a specific band, which is selected from within the infrared signal received from the remote controller.

5. The mouse as set forth in claim 1, wherein the remote controller is switched to a remote pointing mode when the user manipulates a mode selection button, and starts remote pointing control .

6. The mouse as set forth in claim 1, wherein the pointing amount calculation unit calculates a distance to the remote controller based on a size of the optical image received from the image processing unit, and calculates the amount of movement.