CN104049747B - Mouse device for directly controlling cursor with finger - Google Patents
Mouse device for directly controlling cursor with finger Download PDFInfo
- Publication number
- CN104049747B CN104049747B CN201410109161.4A CN201410109161A CN104049747B CN 104049747 B CN104049747 B CN 104049747B CN 201410109161 A CN201410109161 A CN 201410109161A CN 104049747 B CN104049747 B CN 104049747B
- Authority
- CN
- China
- Prior art keywords
- finger
- photographic head
- keyboard
- image
- working face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention discloses a mouse device for directly controlling a cursor with a finger. The mouse device comprises one or more cameras, a left key and a right key. The working method of the mouse device comprises the following steps: continuously taking images of the finger by using the camera(s), and analyzing the images; judging whether the finger is attached to a working plane or not on the basis of three-dimensional vision or a parallax principle or a projection method or a two-reference-point method or parallel points of intersection, and if so, controlling the cursor to perform corresponding movement according to the position change of the finger in multiple frames of images in continuous video streams; otherwise, preventing the cursor from moving. By adopting the mouse device, the movement of the cursor is directly controlled by using the finger. The mouse device has the characteristics of convenience in use, light weight, small size and convenience in carrying. The mouse device can be combined with a keyboard, and can be used for replacing a touch panel when being applied to a notebook computer.
Description
Technical field：The present invention relates to one kind finger directly controls light target mouse apparatus.
Background technology：
Since operating system enters graphic user interface, due to needing to shown cursor on display
(cursor) it is controlled, so mouse becomes beyond keyboard, one of most important peripheral input device.
Optical mouse (optical mouse) and intercomputer are often to be connected with each other using COM, PS/2 or USB interface,
And shown light rotating savings on display moves with the track that optical mouse is moved.
The structure of existing optical mouse include housing, light emitting diode, optical lens, light-receiving processing meanss, button and
Printed circuit board (PCB), light emitting diode is provided in housing, and the opening transmitting light towards housing bottom, therefore works as this photoelectricity Mus
Mark is placed on as after on desktop or mouse pad, light be irradiated on mouse pad i.e. can reflection light, and thus present mouse pad
On image, optical lens be used for be aggregated from light emitting diode launched and by this mouse pad reflect reflection light.
Light-receiving processing meanss receive the reflection light after having optical lens to assemble, and light-receiving processing meanss have a light and pass
Sensor and with graphics processing unit, optical sensor unit is that have Charged Coupled Device (CCD) to be constituted, therefore, it is possible to obtain warp
Image after being assembled by optical lens, typical light processor chip is HDNS-2000, HDNS- of AGILENT company of the U.S.
2051 grade optical mouse dedicated optical receiving and processing device chips, such light-receiving processing meanss chip such as HDNS-2000 cake core
Per second can from photosensitive window pick up 1500 two field pictures.Then, by graphics processing unit, optical sensor is carried in different time
The image taking is compared at its difference, thus judges that mouse moves to displacement, speed etc., and be converted into computer to think
Deliver to after the signal of telecommunication of respective coordinates (Δ X, Δ Y) on computer to control light target to move.
Button be then partly convex be exposed to outside housing, be that button can link with microswitch when being depressed by a user, to control
Cursor processed is clicked (click) action, and printed circuit board (PCB) is used to carry above-mentioned component and is that above-mentioned component is mutual to each other
Electrical connection.
Because optical mouse is the judgement to move position using optical technology, therefore have be difficult be infected with dust,
The advantages of high resolution, movement are smooth, therefore gradually replace the idler wheel mouse of traditional type.
However, the user of optical mouse needs certain space to grip mouse along a planar movement, could effectively control
Cursor processed moves, and therefore must account for quite a lot of space, using upper not very convenient, particularly with the pen usually carried with
Remember this computer it is desirable to it is as far as possible light, compact, and mouse then can take certain space or weight, not square when carrying, using
Just.
If both needing to typewrite, when needing using mouse, the handss of user are had between keyboard and mouse back and forth again
Mobile, this can reduce the work efficiency of user.
The person of being even more important, the mobile mouse of long-time operation not only easily makes muscle fatigue and the finger-joint acid of wrist
Bitterly, seriously more likely cause sport injury because of long-term accumulated.
Content of the invention：
It is an object of the invention to open one kind finger directly controls light target mouse apparatus.
For avoiding the weak point of existing mouse and providing a kind of merging with keyboard, aobvious with the direct control of movement of finger
Show the new mouse apparatus of device onscreen cursor movement, technical problem to be solved is to make using and carrying more of mouse
Convenient, thus more practical.
The present invention includes one or more photographic head, left button, right button, and its method of work is that photographic head is continuously shot finger
Image, by being analyzed to image, judged based on stereoscopic vision or principle of parallax or sciagraphy or two reference point methods
Go out whether finger againsts working face, if it is, in continuous video flowing, according to the change in location of finger-image, taking the photograph
As in the consecutive image that head shoots, according to the change in location of finger-image, control cursor to do and accordingly move；If it is not, then cursor
Do not move；Or judge whether finger againsts surface of keyboard with parallel method, if it is, calculate finger position, according to finger
The movement of position, controls cursor to move.
Working face is surface of keyboard.
Surface of keyboard is smooth.
Refer to support to be arranged between adjacent two row's buttons on keyboard, refer to hold in the palm the fixed support being to prop up finger effect.
Right and left key is located at and refers in support, or is located near QWERTY keyboard space bar, the effect of right and left key and common photoelectricity Mus
The same in mark.
Photographic head can be the 3d photographic head or circumscribed or internal fixed photographic head with multiple points of photographic head.
Photographic head can be infrared camera.
Can refer to be illuminated with light source opponent, in dark surrounds, be illuminated using light source.
Judge whether that the method positioned at working face is：
First determine working face.By analysis of the image, calculate distance or coordinate, and then determine plan-position or side
Journey, or the position relatively with plane for the photographic head.Take photographic head coordinate system, working face takes a little, calculate coordinate a little.
Minimum three points taking not on straight line, according to 3 points of principles determining a plane, determine the Equation f of plane.Or make even
Areal coordinate system, determines the position relatively with plane for the photographic head.
Judge whether finger tip is located on working face again.Determine the position of finger fingertip, judge whether finger fingertip is located at
Working face.
If photographic head is fixing with the position of working face, after calculating plan-position, only need to repeat to judge
Whether finger tip is located at plane.If change in the position of photographic head, after photographic head is static, repeat above-mentioned two step,
Recalculate plan-position, and judge whether finger tip is located at working face.
Judged whether positioned at working face using stereo vision method or principle of parallax, generally include Image Acquisition, video camera
The steps such as demarcation, feature extraction, images match, analytical calculation.Stereoscopic vision or parallax method development are more ripe, have more than comparison
Application, has multiple methods to can decide whether, positioned at working face, not enumerate here, and two kind simplification, specifically are given below
Computational methods.
The moving region of finger in photographic head alignment work plane, multiple photographic head synchronous workings, it is continuously shot finger fortune
Move and working face background image.The optical axis of two photographic head is parallel, and inner parameter is consistent.From the image of photographic head, know
Do not go out finger, and set up the corresponding relation of finger in multiple camera image, because the angle of multiple photographic head is different, it carries
In the image taking out, there is some difference for finger-image, can pass through the dependency of intensity profile or the similarity of feature distribution
Find the part corresponding to each other, such as corresponding part in multiple image for the finger tip etc. method, then calculate finger and such as refer to
Point and the distance of photographic head, and judge whether finger such as finger tip is located on working face.
Finger is as shown in Figure 2 with the computational methods of the distance of photographic head：If 1 point of space P (x, y, z) parallel is put at two
Imaging point in the identical video camera put is (x respectively1, y1), (x2, y2), then knowing base length B, B is two shootings
The distance of head optical axis, and the distance that P point and imaging plane in the case of focal length f, can be calculated
Z=f × B/ (x2- x1)=f × B/ Δ x
If photographic head is fixing relative to the position of working face, then picture point P on image ' (x ', y '), can correspond to
Certain object point P (x, y) on keyboard, P ' and P is unique apart from L, and fixing, on image, each picture point has accordingly
L, before mouse performance, need to calculate the corresponding L of each picture point, as known quantity, be saved in inside mouse.Each
Pixel needs to preserve a vector [x, y, 1], if photographic head has n pixel, just preserves n vector.
If Z=L, P point is located on working face；Otherwise, P point is not on working face.
If photographic head is change with the relative position of working face, after photographic head is static, by photographic head
Image is analyzed, and finds in plane three not three reference points point-blank, calculates reference point and photographic head
Distance, determine the equation of plane, then calculate the distance of finger such as finger tip and photographic head, thus judging that finger fingertip is
No in plane.
Another kind of computational methods are as shown in Figure 3：
At grade, inner parameter is congenial for two photographic head, and the distance of the projection centre line of two photographic head is B,
Focal length is f.If space point coordinates is P (x, y, z), the image of point P is obtained on the photographic head of left and right respectively, their coordinate is respectively
For P1(x1, y1) and Pr(xr, yr).Image coordinate Y of P point is identical, i.e. Y=y1=yr.In two images, D=x1-xr.Then can count
Calculate the coordinate in space for the P point.
x=Bx1/ D；
Y=By/D
Z=Bf/D
Also had with parallax method or 3D vision method a lot, can use, similar approach here does not repeat one by one.
Judge whether that the method positioned at working face can also be two reference point methods：
Take two reference points in the plane, during work, shoot the image of reference point and impact point, calculate two from image
The individual reference point and impact point distance on image, compares in the image captured by two photographic head, and whether distance is identical, if
Identical, then impact point is located on working face；Or by as the corresponding relation with thing, going out impact point from the position calculation of picture
Position, if the position of the impact point being calculated from the image of two photographic head shootings is identical, impact point is located at work
In plane, otherwise not in the plane.
Just can also judge whether finger againsts surface of keyboard with sciagraphy, photographic head photographs the figure of finger and its shade
Picture, the state of analysis shade, judge whether finger is located on working face, whether such as finger tip shade is connected with finger tip, if it is,
Then finger againsts surface of keyboard；If it is not, then finger is not in contact with surface of keyboard.
It is parallel with working face (as keyboard) or close to parallel that parallel intersection method refers to photographic head optical axis, multiple takes the photograph
As head is located at working face edge, position is higher than working face, can photograph the object above plane or plane.First pass through and take the photograph
As the image of head, judge whether finger againsts surface of keyboard, if against surface of keyboard, shot by each and every one photographic head many
The intersection point of image, calculates the position of finger.The implementation method of parallel intersection method has many kinds：
When object is near surface of keyboard, it can be in the sensitive material of photographic head, at one parallel to surface of keyboard
One narrow regional imaging, this region is effective imaging region.When surface of keyboard is left in the position of object, in photosensitive material
In material, effective imaging region is deviateed in the region of imaging, and it is more remote to leave surface of keyboard, then more remote apart from effective imaging region.
When object is near surface of keyboard, in the image that photographic head is clapped, the specific region that subject image is located in image,
Referred to as effective image area, this region is typically a wire parallel to surface of keyboard or long and narrow belt-like zone.Object leaves
During surface of keyboard, subject image position, not in effective coverage, is left more remote, then subject image deviation effective coverage is more remote.Pass through
Whether analysis finger-image is located at effective image area it can be determined that going out finger, typically finger tip, if contact keyboard.
Whether parallel intersection method judgment object can also be using other method, such as by a trigger mechanism in surface of keyboard
(as infrared light supply), launches similar to ultrared light, light (visible ray or black light) is parallel and againsts keyboard table
Face, when surface of keyboard has object, object reflection light, sensitive material will receive reflection light.In turn, if photosensitive
Material receives this light, then show there is object on surface of keyboard.
The image of the finger being photographed by multiple photographic head, the corresponding intersection point of image, in camera position and parameter
The position of finger when knowing, can be calculated.It is a kind of computational methods as shown in Figure 4：
X/ (B-y)=f/y1
x/y=f/y2
P point coordinates x, y can be calculated from this equation.Wherein B is the distance of two photographic head, and y1, y2 take the photograph for two
Distance as P dot image in head.
Parallel intersection method calculates position and can also adopt alternatively, as shown in figure 5, two photographic head and object P structure
Become a triangle, two of which photographic head is known apart from B, by analyze two photographic head image it may be determined that
Angle α, θ, are further able to determine the position of P.
Parallel intersection method or can also post reflection bar on keyboard, and light (visible ray or black light) is mapped to reflection
On bar, reflection bar reflection light, a bright line is formed on sensitive material.When finger againsts surface of keyboard, light is blocked,
Shade is formed on reflection bar, what sensitive material was formed is not just a bright line, but is blocked by shade or finger and be cut into
A section bright line, according to the position of shade, can go out the position of finger with trigonometric function.By the change of finger position, control
Cursor processed moves.If finger is not pressed against surface of keyboard, reflection bar does not have shade, or reflection bar is not blocked,
In sensitive material formation is exactly a bright line.The position of reflection bar usually againsts surface of keyboard and installs.
Or photographic head shoots the background of a little higher than surface of keyboard, when background is blocked by finger, shows that finger againsts key
Panel surface, the position being blocked by background, calculate the position of finger.By the change of finger position, cursor is controlled to move.
Other methods that parallel intersection method calculates position do not enumerate.When object (as finger fingertip) is attached to working face
During (as keyboard) surface, calculate the position of object, then according to change in location, cursor follows movement.
In one preferred version of the present invention, take surface of keyboard to be working face, take three buttons on keyboard：The upper left corner
Esc key, the F12 key in the upper right corner, the Ctrl in the lower right corner the upper right corner be reference point, take photographic head to be coordinate system, calculate three
The coordinate of individual reference point, and then determine the plane equation of surface of keyboard.Image characteristics extraction for convenience, can be with three keys
Word as reference point feature, it is possible to use word is directly as reference point.
In another preferred version of the present invention, take surface of keyboard to be working face, take two reference points on keyboard：Left
The esc key at upper angle, the upper right corner of the F12 key in the upper right corner are reference point, the reference point in two camera image of coupling, simultaneously
Join the image of the finger fingertip in image captured by two photographic head, respectively in the image that two photographic head shoot, measure
Finger tip and the distance of two reference points, if corresponding apart from identical, finger tip is located on working face.Otherwise, finger tip does not exist
On working face.When taking reference point, reference point needs to meet two conditions：1st, reference point is located on working face；2nd, finger
Finger tip is only in a lateral movement of two reference point lines.
If finger (such as finger tip) is located on working face, by the handss in two width consecutive images in same photographic head
Refer to difference or the motion conditions of (such as finger tip) position, control the motion of light target.
Many fingers against simultaneously surface of keyboard mobile when, different move mode, different operations can be defined.For example
Left and right forefinger is simultaneously downward, represents downward page turning；Left and right forefinger reverse movement, represents amplifieroperation.
Brief description：
The schematic diagram of the mouse that Fig. 1 is merged with keyboard
1 left button
2 right buttons
3 photographic head
4 photographic head
The visual field of 5 left photographic head
The visual field of 6 right photographic head
7 refer to support
Fig. 2 computational methods schematic diagram
The imaging plane of 1 left photographic head
The imaging plane of 2 right photographic head
The camera lens of 3 left photographic head
The camera lens of 4 right photographic head
The optical axis of 5 left photographic head
The optical axis of 6 right photographic head
Fig. 3 another kind computational methods schematic diagram
A kind of parallel intersection method of Fig. 4 computational methods schematic diagram
Fig. 5 parallel intersection method another kind computational methods schematic diagram
Specific embodiment
The finger mouse 1 that embodiment 1 is combined with keyboard of notebook computer
The application of this finger mouse and notebook computer, including the following units：
Two photographic head：The parameter of photographic head is identical, and optical axis is parallel.Photographic head is located at the side above notebook computer screen
In frame, become left-right situs.Photographic head is aligned downwards in the middle part of keyboard, and during work, two photographic head are synchronous, be continuously shot, every second beats
Take the photograph 100 two field pictures.
Left button, right button are located near key.backspace.
Surface of keyboard is smooth.
Surface of keyboard can be considered as a plane.
Refer to the clearance position that support is arranged between adjacent two row's buttons on keyboard, referring to hold in the palm has been to prop up consolidating of finger effect
Fixed rack, in finger motion, provides for palm and supports.
In three-dimensional system of coordinate, surface of keyboard is taken to be xoy, screen rotation axle is x-axis, the keyboard upper left corner is initial point, shooting
Head is located at one on the circumference that x-axis rotates.For a notebook computer, its physics size, photographic head are on notebook
The distance between position, two photographic head etc. can be considered as constant, so coordinate in three-dimensional system of coordinate for the photographic head can be counted
Calculate, according to the open angle of screen, coordinate in three-dimensional system of coordinate for the photographic head can be calculated, screen open angle is big
Little computational methods can be measured using an angular transducer；Can also take on keyboard known to size, a position
Object of reference, in different angle, different with reference to object image size or position, before work, set up both corresponding relations, in work
When making, the reference object image that photographic head shoots, obtain the angle of screen according to its size or position, calculate photographic head further
Coordinate.
, when opening notebook every time, angle that screen is opened and the angle that last time opens may be different for user, so
Use front, the coordinate of photographic head to be recalculated every time.Operationally, the position of screen is usually fixed, photographic head coordinate
Constant.
Above-mentioned calculating can directly or indirectly calculate each point of surface of keyboard and photographic head apart from Z, by parallax method or
3D vision, calculates finger tip with photographic head apart from L, Z=L, then finger tip is positioned at surface of keyboard.
Or take photographic head coordinate system, the esc key in the upper left corner, the F12 key in the upper right corner, the upper right corner of the Ctrl in the lower right corner
For the reference point of surface of keyboard, calculate the distance of photographic head and reference point, obtain the plane formula of surface of keyboard, then from image
In find finger tip, finger tip coordinate is calculated by parallax method, judges that whether finger tip is located at plane.
The keyboard operation of user and mouse action all complete on keyboard, and motion on keyboard for the finger is divided into three classes：1、
Keystroke action：Finger moves from top to bottom, and direction and surface of keyboard are substantially vertical, meanwhile, the telecommunications that typically a button is pressed
Number；2nd, effective action：Finger againsts surface of keyboard and moves, and it is cursor action that a finger againsts surface of keyboard mobile, now,
The mobile control light target of finger moves；When many fingers against surface of keyboard movement, according to different gestures, represent different
Operation, the meaning of gesture, can be self-defined.As two fingers move down simultaneously, represent scroll bar and move down；Four fingers
Move down, represent window and minimize operation；Two finger move toward one another, represent and close a program；Two fingers are dorsad transported
Dynamic, represent and open a program.3rd, other actions：Movement in addition to moving vertically and against surface of keyboard motion, this kind of
Action is often the habitual movement of user or unintentionally action.By being analyzed to the use habit of user, user operation key
The action of disk and unintentionally action do not against surface of keyboard.
Mouse needs to judge above-mentioned three kinds of user actions, specifically, is to need to identify the 2nd class, effective action.Judge
Method is：Judge whether finger againsts surface of keyboard, if the 2nd class effective action, mouse is responded；To the first kind or
Three class invalid actions, mouse is refused to respond.
In addition take a time as invalid threshold value, further discriminate between the 1st class action and the 2nd class action, it is to avoid operated key
During disk, maloperation in mouse.When finger down keyboard, during this moment plays invalid threshold value, finger mouse
Stop response, cursor keeps original position.Using invalid threshold value, when user is continuous on keyboard, when quickly pushing button, Mus
Mark quits work.Invalid threshold value value is 0.2 second it is also possible to be adjusted according to the use habit of user, such as take 0.1 second or
0.5 second.Invalid threshold value can be used as supplementary meanss, it is to avoid be maloperation in user key-press.When user is defeated in button
When entering word, within a short period, in such as 0.2 second, mouse will not respond.Or motion finger is detected is to transport up and down
When dynamic, in time threshold, cursor is not responding to.
And gap difference is existed between each button on common keyboard, in the present invention, the surface of keyboard is smooth, so that
Movement in finger.Meanwhile, between the two rows button in keyboard central authorities, the fixed support propping up finger effect has been installed,
Referred to as refer to support, when the finger of user is mobile in surface of keyboard, other fingers can be placed in finger support, and this had both been avoided that other fingers
Mistakenly push button, the also movement for finger provides the strong point and impetus.Right and left key may be mounted in finger support, with food
Refer to, middle finger or the third finger operate, also may be installed near the space bar of QWERTY keyboard, operated by thumb.
During using finger mouse, the keyboard operation of user and mouse action all complete on keyboard, when using input through keyboard
When, user presses the upper and lower keystroke of normal mode, the same with the occupation mode of common keyboard；When using a mouse, handss do not need from
Key point disk, other fingers are placed on the upper remains stationary of finger support, and food root finger againsts surface of keyboard and moves, and light rotating savings is moved with forefinger
Dynamic, the mode of operation of right and left key is consistent with common mouse；When needing gesture operation, many fingers against the same time shift of keyboard
Dynamic, you can to execute self-defining corresponding operating.
Finger mouse can replace the touch pad on notebook computer.
The finger mouse 2 that embodiment 2 is combined with keyboard of notebook computer
Including a photographic head, a light source, left button, right button.Photographic head is arranged on the frame above notebook screens
Centre position, be aligned keyboard central authorities；Light source is located at photographic head side, is directed at keyboard；Right and left key is located near key.backspace.
Using sciagraphy judge finger whether with keypad contact.During work, source alignment keyboard provides illumination, so that finger is existed
Shade is formed on keyboard.Photographic head shoots the consecutive image of finger motion, shooting 100 two field picture per second, shoots in photographic head
In each two field picture, identify the shade of finger and finger, identify finger fingertip and its shade further, image is counted
Calculate the finger tip of finger and the distance of its finger tip, if this distance less than a threshold value or is 0, show finger and key
Panel surface contacts.If finger and keypad contact, the change in location of finger from front and back's two field pictures, cursor in control screen
Motion.
The finger mouse 1 that embodiment 3 is combined with computer-keyboard
As shown in Figure 1.
One support is installed on keyboard, two photographic head are parallelly mounted on support, be directed at keyboard, support and keyboard
Position relationship is known, and fixing, the present embodiment other side is with embodiment 1.
The finger mouse 2 that embodiment 4 is combined with computer-keyboard
Two circumscribed photographic head are arranged in the frame above the screen of desktop computer, become left-right situs, are directed at keyboard, take the photograph
As the distance between head is known quantity, photographic head is connected with system by usb interface.In this example, photographic head and surface of keyboard
Distance is not fix and change irregular, should calculate keyboard plan position by technology such as three-dimensional measurement, three-dimensional reconstructions, and survey
Amount finger fingertip coordinate, the three-dimensional measurement based on binocular vision, three-dimensional reconstruction comparative maturity, differ string herein
Lift.Judging whether finger tip againsts surface of keyboard, if it is, judging the motion conditions according to finger tip, controlling cursor movement.
Mouse right and left key is arranged near key.backspace, is operated by thumb.
At present, the keyboard of desktop computer and mouse and screen are detached, and during operation, the handss of user need in keyboard and Mus
Move back and forth between mark, very inconvenient.Mouse apparatus on notebook computer are usually touching control rod or touch pad, and touching control rod accounts for
Small volume, easy to carry, but occupation mode and conventional mouse difference are too big, using inconvenience.The body that touch pad takies
Long-pending big, and itself and keyboard are also actually detached.Mouse disclosed by the invention and keyboard ideally merge, and are not take up key
Disk body amasss, and very convenient to carry, during use, handss do not need to leave keyboard, meanwhile, directly controls light target to move with finger, than normal
The occupation mode of rule mouse is convenient.
The finger mouse that embodiment 5 is combined with panel computer external connection keyboard
When using panel computer work, generally require to use external connection keyboard, now, using finger mouse, can remove generally
Optical mouse, significantly improve portability and ease of use.
In the frame of panel computer, built-in two photographic head of installation, the inner parameter of two photographic head is consistent, and optical axis is put down
OK.Or a 3D photographic head.Outside the space bar of external connection keyboard install left mouse button right button, external connection keyboard left and right on
It is reference point that two small red dots are drawn at angle, and the angle of photographic head can shoot the image of whole keyboard range.During work, photographic head shoots
Finger and reference dot image, measure the image distance of finger fingertip and reference point, if corresponding distance in two photographic head
Identical, then finger fingertip is located at surface of keyboard.Analyze consecutive image further, by finger tip consecutive image relative position
Change, control screen light target position is moved；If distance is different, do not make subsequent treatment.The function of left button right button and common
The function of optical mouse is consistent.
The relative position of keyboard and panel computer can be change.
The finger mouse 3 that embodiment 6 is combined with computer-keyboard
The consistent photographic head of two parameters is installed at keyboard edge, and one is located near F4 key, and one is located near F6 key, takes the photograph
As head position, optical axis angle are fixed and it is known that photographic head optical axis is slightly higher and be close in surface of keyboard, optical axis is parallel to keyboard table
Face, two photographic head optical axises are parallel to each other.Right and left key is located near key.backspace.
Because optical axis is parallel to surface of keyboard, and it is close to surface of keyboard, so, the image objects of surface of keyboard are in center
Position, then effective image area be one parallel to surface of keyboard, positioned at picture centre banding level (if keyboard level is put
Put) region, if it is highly 3 pixels.
In the picture, if having image in the high effective image area of this 3 pixels, show finger in keyboard table
Face, now, in the become image of two photographic head, takes the central point of finger-image, measures its position, then can obtain finger
Finger tip location.
According to the change of finger fingertip position, light target is controlled to move.The using method of right and left key is consistent with common mouse.
The above, be only presently preferred embodiments of the present invention, and not the present invention is done with any pro forma restriction, any ripe
Know professional and technical personnel, in the range of without departing from technical solution of the present invention, it is possible to use the method for the disclosure above and technology
Content makes a little change, but every content without departing from technical solution of the present invention, according to the technology of the present invention essence to
Any simple modification, equivalent variations and modification that upper embodiment is made, belong in the range of technical solution of the present invention.
Claims (10)
1. one kind finger directly controls light target mouse apparatus, including one or more photographic head, left button, right button, its work
Method is that photographic head shoots the consecutive image of finger motion, by being analyzed to image, is sentenced with parallel intersection method or shadowing method
Whether finger of cutting off the hands againsts working face, if it is, according to the movement of finger position, controlling cursor to move；
Shadowing method：One photographic head, above working face, alignment work plane shoots for position, and a source alignment job is flat
Face, the image of photographic head shooting finger and its shade analysis of the image, if finger is connected with shade or distance is less than one
Threshold value, then finger plaster move on working face, then by position on working face for the finger, control cursor to move；
Parallel intersection method：Multiple photographic head, are installed on working face edge, and higher than working face, photographic head optical axis is flat with work
Face is parallel or close to parallel, and photographic head is continuously shot the finger on working face, and analysis of the image, by judging finger-image
Whether image effective district, parallel to working face infrared ray whether be blocked, reflection bar has shade or part is blocked, carries on the back
Whether scape is blocked, and judges whether finger againsts working face surface；If being attached to working face surface, by the geometry of image
Relation calculates finger position, is moved according to finger position, controls cursor to move.
2. mouse apparatus according to claim 1, is characterized in that：Working face is surface of keyboard.
3. mouse apparatus according to claim 2, is characterized in that：Surface of keyboard is smooth.
4. mouse apparatus according to claim 2, is characterized in that：Keyboard is installed between two adjacent row's buttons and refers to
Support, refers to hold in the palm the support being to prop up finger effect.
5. mouse apparatus according to claim 1, is characterized in that：Right and left key is located at and refers in support, or is located at keyboard space
Near key.
6. mouse apparatus according to claim 1, is characterized in that：Reflection bar is installed.
7. mouse apparatus according to claim 1, is characterized in that：Photographic head is infrared camera, or carries multiple points
The 3D photographic head of photographic head, or circumscribed photographic head, or embedded photographic head.
8. mouse apparatus according to claim 1, is characterized in that：Refer to be illuminated with light source opponent.
9. mouse apparatus according to claim 1, is characterized in that：When button is detected and being pressed, or finger does
During up and down motion, take a period of time threshold value, be in this threshold value, cursor is not responding to, time threshold value is 0.1 second -0.5 second.
10. mouse apparatus according to claim 1, is characterized in that：When many fingers against surface of keyboard movement simultaneously, no
Same move mode, defines different operations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410109161.4A CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410044519.X | 2014-01-24 | ||
| CN201410044519 | 2014-01-24 | ||
| CN201410044519X | 2014-01-24 | ||
| CN201410109161.4A CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104049747A CN104049747A (en) | 2014-09-17 |
| CN104049747B true CN104049747B (en) | 2017-02-08 |
Family
ID=51502715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410109161.4A Expired - Fee Related CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104049747B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104991648B (en) * | 2015-07-20 | 2018-05-11 | 江苏惠通集团有限责任公司 | Screen input system |
| CN106066704A (en) * | 2016-06-04 | 2016-11-02 | 胡世曦 | A kind of mouse using radio-frequency technique |
| CN106020519A (en) * | 2016-07-14 | 2016-10-12 | 胡世曦 | Novel mouse |
| JP2018085552A (en) * | 2016-11-21 | 2018-05-31 | セイコーエプソン株式会社 | Projector system |
| CN117472189B (en) * | 2023-12-27 | 2024-04-09 | 大连三通科技发展有限公司 | Typing or touch control realization method with physical sense |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101963848A (en) * | 2009-12-29 | 2011-02-02 | 胡世曦 | Method for determining if target point belong to plane, mouse and touch screen |
| CN103487938A (en) * | 2013-08-28 | 2014-01-01 | 成都理想境界科技有限公司 | Head mounted display |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030132913A1 (en) * | 2002-01-11 | 2003-07-17 | Anton Issinski | Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras |
-
2014
- 2014-03-17 CN CN201410109161.4A patent/CN104049747B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101963848A (en) * | 2009-12-29 | 2011-02-02 | 胡世曦 | Method for determining if target point belong to plane, mouse and touch screen |
| CN103487938A (en) * | 2013-08-28 | 2014-01-01 | 成都理想境界科技有限公司 | Head mounted display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104049747A (en) | 2014-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10324566B2 (en) | Enhanced interaction touch system | |
| US9268413B2 (en) | Multi-touch touchscreen incorporating pen tracking | |
| US8842076B2 (en) | Multi-touch touchscreen incorporating pen tracking | |
| KR102335132B1 (en) | Multi-modal gesture based interactive system and method using one single sensing system | |
| CN104049747B (en) | Mouse device for directly controlling cursor with finger | |
| CN101776953A (en) | Optical positioning method and finger mouse integrated with keyboard | |
| US8854433B1 (en) | Method and system enabling natural user interface gestures with an electronic system | |
| KR100918157B1 (en) | Portable electronic device with mouse-like capabilities | |
| US10452206B2 (en) | Projection video display device and video display method | |
| CN108700957B (en) | Electronic system and method for text entry in a virtual environment | |
| US9494415B2 (en) | Object position determination | |
| JP2009505305A (en) | Free space pointing and handwriting | |
| KR20120135184A (en) | System and method for a virtual multi-touch mouse and stylus apparatus | |
| KR20100072207A (en) | Detecting finger orientation on a touch-sensitive device | |
| CN103744542B (en) | Hybrid pointing device | |
| US10558279B2 (en) | Dual mode optical navigation device | |
| TW201738695A (en) | Method of generating keyboard gesture command, computer program product thereof, and non-transitory computer-readable medium thereof | |
| TWI476639B (en) | Keyboard device and electronic device | |
| CN103365485A (en) | Optical Touch Sensing Device | |
| CN102163092B (en) | Finger mouse | |
| KR100968205B1 (en) | Apparatus and Method for Space Touch Sensing and Screen Apparatus sensing Infrared Camera | |
| TW201337649A (en) | Optical input device and input detection method thereof | |
| KR101385263B1 (en) | System and method for a virtual keyboard | |
| TWI490757B (en) | High resolution and high sensitivity optically activated cursor maneuvering device | |
| KR102101565B1 (en) | Media display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170208 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |