WO2012129958A1

WO2012129958A1 - Finger mouse

Info

Publication number: WO2012129958A1
Application number: PCT/CN2012/000340
Authority: WO
Inventors: 胡世曦
Original assignee: Hu Shixi
Priority date: 2011-03-25
Filing date: 2012-03-19
Publication date: 2012-10-04
Also published as: CN102163092A; CN102163092B

Abstract

A finger mouse, comprising a camera, a light ray emitting and receiving apparatus, a judging unit, an image identification unit, a calculation unit and a communication control unit. A system judges whether the moving of the finger is touching the surface of the keyboard, if yes, and there is no electrical signal from key pressing, then the cursor moves with the moving of the finger. The finger mouse perfectly integrates a mouse and a keyboard; when using the finger mouse, a user does not need to wear any added device on the finger, and the hand does not need to move away from the keyboard, but moves directly on the surface of the keyboard to control the moving of the cursor on the screen. The finger mouse is more convenient than using a conventional mouse and is an upgraded and updated product of the current mouse.

Description

Finger mouse

Technical field

The invention relates to a finger mouse.

Background technique

Since the operating system entered the graphical user interface, the mouse has become one of the most important peripheral input devices in addition to the keyboard due to the need to control the cursor displayed on the display.

Optical mouse and computer are often connected by COM, PS/2 or USB interface, and the cursor displayed on the display moves with the movement of the optical mouse.

The structure of the existing optical mouse comprises a housing, a light emitting diode, an optical lens, a light receiving processing device, a button and a printed circuit board. The light emitting diode is disposed in the housing and emits light toward an opening at the bottom of the housing, so that the photoelectric When the mouse is placed on a table or mouse pad, light is reflected on the table or mouse pad, and the light lens is used to collect the reflected light emitted by the LED and reflected by the desktop or mouse pad. The light receiving processing device receives the reflected light collected by the optical lens, and the light receiving processing device has a light sensor unit and an image processing unit; the light sensor unit is constituted by a charge coupled device (CCD), and thus can be acquired after being collected via the optical lens The image, the typical light processing device chip is the optical light receiving processing device chip of the optical mouse of HNDS-2000, HDNS-2051, etc. of American AGILENT Company. The light receiving processing device chip such as HDNS-2000 type chip can be taken from the photosensitive window every second. Pick up 1500 frames of images. Then, the image processing unit compares the difference between the images extracted by the photosensors at different times, thereby determining the displacement amount and speed of the mouse movement. Degree, etc., and convert it into an electrical signal corresponding to the computer's corresponding coordinates (ΔΧ, ΔΥ) and send it to the computer to control the movement of the cursor.

When the button of the mouse is pressed by the user, the button will interlock the micro switch to control the cursor to perform a click action. Since the optical mouse uses optical technology to determine the moving position, it is not easy to contaminate the dust and distinguish The advantages of high speed, smooth movement, etc., have gradually replaced the traditional wheel mouse.

However, users of optical mice need a certain amount of space to hold the mouse along a plane to effectively control the movement of the cursor, so it must take up a lot of space, which is not very convenient to use, especially for laptops that are often carried around. It is as light and compact as possible, and the mouse takes up a certain amount of space or weight, which is not convenient enough to carry and use.

If both typing and mouse use are required, the user's hand has to move back and forth between the keyboard and the mouse, which reduces user productivity.

Especially important, long-term operation of the mobile mouse is not only easy to make the muscles of the wrist and the joints and joints are sore, it is more likely to cause sports injuries due to long-term accumulation.

Summary of the invention

The object of the present invention is to disclose a finger mouse; to avoid the inadequacy of the existing mouse, and to provide a novel mouse device for directly controlling the movement of the cursor on the screen of the display by the movement of the finger, which makes the computer control more convenient and thus more practical.

The object of the present invention can be achieved by the following techniques:

A mouse device includes a left button and a right button, and is characterized by:

Camera: Shoots moving objects above the work plane and work plane; Transmitting and receiving device: The transmitting device emits a laser beam above the working plane, parallel to the working plane. The receiving device detects the reflected laser beam. Judging unit: used to judge whether the moving object is in contact with the working plane; when the moving object is in contact with the working plane, it will inevitably contact with the laser beam that is in close contact with the plane, causing the laser light to be disturbed, and the laser beam is reflected, and the receiving device receives When the laser beam is detected, or if the laser beam is detected to be disturbed, the moving object is in contact with the working plane.

The image recognition unit: analyzes the image captured by the camera, and recognizes the image of the animal from the working plane background image;

Calculating unit: if the moving object is in contact with the working plane, calculating the moving speed of the image of the object, or the speed at which the object moves along the working plane;

Control communication unit: Transfer the speed of the contact part along the working plane or the speed of the movement of the contact part image and the left button and right click key information to the host system to control the movement of the cursor on the screen or perform related operations.

In the mouse device, the moving object is a user's finger.

In the mouse device, the working plane is a keyboard surface.

In the mouse device, the keyboard surface is smooth.

In the mouse device, a finger-holding finger rest is mounted between two adjacent rows of buttons on the keyboard.

In the mouse device, the left button and the right button are located on the finger rest, or are located near the space bar on the standard keyboard.

The launcher emits a laser beam that is above the work plane, parallel to the work plane, against the work plane. When a moving object comes into contact with the working plane, the object will inevitably block or reflect the laser beam, causing the laser beam to be disturbed. When the moving object leaves the work plane, because the laser beam is close The working surface, so the moving object will also be out of contact with the laser speed, and will not cause the laser beam to disturb. The receiving device determines whether the laser beam is disturbed.

The movement of the finger on the keyboard is divided into three categories: 1. Keystroke action: The finger moves from top to bottom, and the direction is substantially perpendicular to the surface of the keyboard. At the same time, there is generally an electrical signal that the button is pressed; 2. Effective action: Fingers are attached The surface of the keyboard moves, and the finger moves against the surface of the keyboard to move the cursor. At this time, the movement of the finger controls the movement of the cursor; 3. Other actions: In addition to vertical movement and movement other than the surface movement of the keyboard, such actions are often users. Habitual action or unintentional action.

When the mouse device is working normally, the judging unit needs to distinguish the three types of finger movements by: when it is detected that a button is pressed, it is determined to be a keystroke action, and the judging unit issues a stop command, taking a delay time, from When it is detected that the button is pressed, the judgment unit issues a stop command within the delay time. For example, the delay time is 0.5 seconds, after the button is pressed for 0.5 seconds, the mouse pauses the response; when the receiving device does not detect the laser beam disturbance, it indicates that other actions or the user does not operate. Only when the receiving device detects the disturbance of the laser beam and the button is not pressed, the time has elapsed. When these conditions are satisfied at the same time, the motion is an effective action, the judgment unit issues a work instruction, and the mouse receives the response.

The image recognition unit analyzes the image captured by the camera, recognizes the image of the animal from the working plane background image, and further recognizes the image of the moving object and the planar contact portion, and determines the position of the contact portion in the image.

The calculating unit calculates the moving speed of the moving object image, or calculates the moving speed of the moving object according to the correspondence between the image position and the actual position, and sends it to the control communication unit. When the judging unit judges that the motion is an effective motion, the image recognizing unit recognizes the image of the moving object from the image photographed by the camera, and determines the position of the moving object image, and the calculating unit calculates the continuous image according to the continuously photographed moving object image position. The speed of movement of a moving object image, or moving object The speed of movement. To further avoid erroneous operation, set a speed threshold. When the calculated speed value exceeds the threshold range, the motion is invalid.

Control communication unit: Transfer the speed information of the movement and the left-click and right-click key information to the host system to control the movement of the cursor on the screen or perform related operations.

Compared with the prior art, the present invention avoids the inadequacy of the existing mouse, and provides a novel mouse device for directly controlling the movement of the cursor on the screen of the display by the movement of the finger, which makes the computer control more convenient and thus more practical.

DRAWINGS

Figure 1 is a schematic diagram of a notebook computer using a finger mouse combined with a keyboard.

The reference numerals in the figure are: 1 is the camera; 2 is the display; 3 is the receiving device; 4 is the keyboard; 5 is the transmitting device.

detailed description

The finger mouse combined with the keyboard of the embodiment is as shown in FIG. 1:

Includes the following units:

Camera: Shoots the surface of the keyboard and the movement of the finger above the keyboard. The camera is located in the middle of the display, aligned with the center of the keyboard, and the field of view covers the central area of the keyboard.

The emitting device emits an infrared laser beam, which is located above the keyboard, parallel to the plane of the keyboard, and is placed on the surface of the keyboard and distributed in a plane. The receiving device receives the reflected laser beam and determines whether the laser beam is disturbed.

The movement of the finger on the keyboard is divided into three categories: 1. Keystroke action: The finger moves from top to bottom, It is generally perpendicular to the surface of the keyboard. At the same time, there is generally an electrical signal that the button is pressed. 2. Effective action: The finger moves against the surface of the keyboard, and a finger moves against the surface of the keyboard to move the cursor. At this time, the movement control of the finger The movement of the cursor; 3, other actions: In addition to vertical movement and movement in addition to the surface movement of the keyboard, such actions are often the user's habitual action or unintentional action.

When the mouse device is working normally, the judging unit needs to distinguish the three types of finger movements by: when it is detected that a button is pressed, it is determined to be a keystroke action, and the judging unit issues a stop command, taking a delay time, from When it is detected that the button is pressed, the judgment unit issues a stop command within the delay time. For example, the delay time is 0.5 seconds, after the button is pressed for 0.5 seconds, the mouse pauses the response; when the receiving device does not detect the laser beam disturbance, it indicates that other actions or the user does not act. Only when the receiving device detects the disturbance of the laser beam and the button is not pressed, the time has elapsed. When these conditions are satisfied at the same time, the motion is an effective action, the judgment unit issues a work command, and the mouse starts to respond.

Image recognition unit: The image of the finger is recognized from the background image of the keyboard, and the shape of the user's finger is also substantially the same, so it is very easy to recognize the image of the finger from the background image of the keyboard. Usually, the part where the finger touches the surface of the keyboard is a fingertip, and the fingertip has obvious features such as a nail, a contour edge, etc. According to these features, the image recognition unit further recognizes the image of the fingertip from the image of the finger, and the image recognition technology is currently Quite mature, no longer repeat here. After the finger image is recognized, the position of the fingertip in the image is further determined.

Calculation unit: Calculates the speed at which the fingertip moves along the surface of the keyboard, including the rate and direction, or the speed of movement of the fingertip image. When the judging unit judges that the motion is an effective motion, the image recognizing unit recognizes the image of the fingertip and determines the position of the fingertip. In the moving image continuously captured by the camera, the position of the image of the fingertip (or the corresponding point of the fingertip) in the two images is removed at a time interval of two moments, that is, the moving speed of the image of the fingertip of the finger, or according to Correspond to the actual position Relationship, calculate the speed of movement of the fingertips. To further avoid erroneous operation, set a speed threshold. When the calculated speed value exceeds the threshold range, the motion is invalid. Speed threshold

0. 5cm / s - 5cm / s.

Control communication unit: Send the motion speed information of the image of the fingertip or the fingertip and the keystroke information of the left and right keys to the host system to perform the corresponding operations.

There is a difference between the keys on the ordinary keyboard and the keys on the ordinary keyboard. In the present invention, the surface of the keyboard is smooth to facilitate the movement of the fingers. At the same time, a fixing bracket for holding a finger is arranged between the upper and lower rows of buttons in the center of the keyboard, which is called a finger rest. When the user's finger moves on the keyboard surface, other fingers can be placed on the finger rest, which can Avoiding other fingers erroneously pressing the button also provides a support point and a force point for the movement of the finger. The left and right buttons can be mounted on the finger rest, operated with the index finger, middle finger or ring finger, or near the space bar of the standard keyboard, operated by the thumb.

When the user uses the keyboard to input, the finger presses the key in the normal way, which is the same as the normal keyboard. When using the mouse, the hand does not need to leave the keyboard, the other fingers are placed on the finger rest to remain still, and a certain finger is attached. As the keyboard surface moves, the cursor moves with the finger, and the left and right keys operate in the same way as a normal mouse.

At present, the keyboard and mouse of the desktop are separated. When operating, the user's hand needs to move back and forth between the keyboard and the mouse, which is inconvenient. The mouse device used in the notebook computer is generally a touch bar or a touch pad. The touch bar occupies a small volume and is convenient to carry, but the difference between the use mode and the conventional mouse is too large, and the use is not accustomed. The touchpad takes up a lot of space and is actually separate from the keyboard. The mouse and the keyboard disclosed by the invention are perfectly integrated, do not occupy the keyboard volume, and are very convenient to carry. The hand does not need to leave the keyboard when using, and at the same time, the movement of the cursor is directly controlled by the finger, which is more convenient than the use of the conventional mouse.

Claims

Claim

1. A mouse device, comprising a left button and a right button, wherein:

Camera: Shoots moving objects above the work plane and work plane;

Transmitting and receiving device: The transmitting device emits a laser beam, the laser beam is above the working plane, parallel to the working plane, and the receiving device detects the laser beam;

Judging unit: used to judge the type of motion of the moving object;

Image recognition unit: analyzing an image captured by a camera, identifying an image of the moving object from the working plane background image, and determining a position of the moving object image in the image;

Calculation unit: If the motion type is an effective motion, calculate the motion speed of the image of the object, or the speed at which the object moves along the work plane;

2. The judging unit according to claim 1, wherein the function of the judging unit is: when the receiving device detects the laser light disturbance, indicating that the moving object is in contact with the working surface; when no keyboard button is detected, the keyboard button is pressed. When it is down, or when the delay time has been exceeded, it indicates that the moving object has no button action; when the above two conditions are satisfied at the same time, it is judged that the motion type is a valid action.

3. The mouse device according to claim 1, wherein: the moving object is a user's finger.

4. The mouse device according to claim 1, wherein: the work plane is a keyboard surface.

5. The mouse device according to claim 1, wherein: the surface of the keyboard is smooth. '

6. The mouse device according to claim 1, wherein: a finger rest that plays a finger is mounted between two adjacent rows of buttons on the keyboard.

7. The mouse device according to claim 1, wherein: the left button and the right button are located on the finger pad or are located near the space bar on the standard keyboard.

8. The mouse device according to claim 1, wherein: a threshold value of the movement speed is set.