CN104049747A - Mouse device for directly controlling cursor with finger - Google Patents
Mouse device for directly controlling cursor with finger Download PDFInfo
- Publication number
- CN104049747A CN104049747A CN201410109161.4A CN201410109161A CN104049747A CN 104049747 A CN104049747 A CN 104049747A CN 201410109161 A CN201410109161 A CN 201410109161A CN 104049747 A CN104049747 A CN 104049747A
- Authority
- CN
- China
- Prior art keywords
- finger
- keyboard
- camera
- cursor
- mouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a mouse device for directly controlling a cursor with a finger. The mouse device comprises one or more cameras, a left key and a right key. The working method of the mouse device comprises the following steps: continuously taking images of the finger by using the camera(s), and analyzing the images; judging whether the finger is attached to a working plane or not on the basis of three-dimensional vision or a parallax principle or a projection method or a two-reference-point method or parallel points of intersection, and if so, controlling the cursor to perform corresponding movement according to the position change of the finger in multiple frames of images in continuous video streams; otherwise, preventing the cursor from moving. By adopting the mouse device, the movement of the cursor is directly controlled by using the finger. The mouse device has the characteristics of convenience in use, light weight, small size and convenience in carrying. The mouse device can be combined with a keyboard, and can be used for replacing a touch panel when being applied to a notebook computer.
Description
Technical field: the present invention relates to a kind of with the direct mouse apparatus of controlling cursor of finger.
Background technology:
Since operating system enters graphic user interface, owing to need to cursor shown on display (cursor) being controlled, so becoming, mouse beyond keyboard one of most important peripheral input media.
Optical mouse (optical mouse) is often to utilize COM, PS/2 or USB interface to interconnect with intercomputer, and on display, shown cursor can move along with the track that optical mouse moves.
The structure of existing optical mouse comprises housing, light emitting diode, optical lens, light-receiving treating apparatus, button and printed circuit board (PCB), light emitting diode is arranged in housing, and towards an opening emission of light of housing bottom, therefore after on this optical mouse is placed on as desktop or mouse pad, light be irradiated on mouse pad can reflection ray, and presenting thus the image on mouse pad, optical lens is used for assembling the reflection ray that autoluminescence diode is launched and reflect on mouse pad thus.
Light-receiving treating apparatus receives the reflection ray having after optical lens is assembled, and light-receiving treating apparatus has an optical sensor and with graphics processing unit, optical sensor unit is to have Charged Coupled Device (CCD) to form, therefore can obtain the image after assembling via optical lens, typical light processor chip is the optical mouse dedicated optical receiving and processing device chips such as HDNS-2000, HDNS-2051 of U.S. AGILENT company, and such light-receiving treating apparatus chip is as per second in HDNS-2000 cake core can pick up 1500 two field pictures from sensitization window.Then, the image being extracted at different time for optical sensor by graphics processing unit is compared its difference place, judge that thus mouse moves to displacement amount, speed etc., and be converted into computing machine and think to deliver on computing machine to control the movement of cursor after the electric signal of respective coordinates (Δ X, Δ Y).
To be that part is protruding be exposed to outside housing button, when being pressed by user, is, button can link with microswitch, to control cursor, clicks (click) action, and printed circuit board (PCB) is for carrying above-mentioned member and being that above-mentioned member is electrically connected to each other mutually.
Because optical mouse is to adopt optical technology to carry out the judgement of shift position, therefore have and be difficult for being infected with the advantages such as dust, resolution is high, movement is smooth, therefore replace gradually the idler wheel mouse of traditional type.
Yet, the user of optical mouse needs certain space to grip mouse along a planar movement, could effectively control cursor movement, therefore quite a lot of space must account for, not very convenient in use, especially for the notebook computer of usually carrying, require it as far as possible light, small and exquisite, mouse can take certain space or weight, convenient not when carrying, using.
If both needed typewriting, while needing to use mouse again, user's hand has to move around between keyboard and mouse, and this can reduce user's work efficiency.
The person of being even more important, long-time operation rolling mouse not only easily makes the muscular fatigue at wrist position and finger-joint ache, and seriously more may cause athletic injury because of long-term accumulated.
Summary of the invention:
The object of the invention is to disclose a kind of with the direct mouse apparatus of controlling cursor of finger.
For avoiding the weak point of existing mouse that a kind of and keyboard fusion, directly control cursor movement on indicator screen with the movement of finger novel mouse apparatus is provided, technical matters to be solved be make mouse use and carry convenient, thereby more practical.
The present invention includes one or more cameras, left button, right button, its method of work is, camera is taken the image of finger continuously, by image is analyzed, judges finger whether pasting working face based on stereoscopic vision or principle of parallax or sciagraphy or two reference point methods, if, in continuous video flowing, according to the change in location of finger-image, in the consecutive image of taking at camera, according to the change in location of finger-image, control cursor and do corresponding movement; If not, cursor does not move; Or with parallel method judgement finger, whether pasting surface of keyboard, if so, calculating finger position, according to the movement of finger position, controlling cursor movement.
Working face is surface of keyboard.
Surface of keyboard is level and smooth.
Refer to that holder is arranged between two row's buttons adjacent on keyboard, refers to that holder has been the fixed support that props up finger effect.
Right and left key is positioned at and refers to that holder is upper, or is positioned near QWERTY keyboard space bar, the same with in common optical mouse of the effect of right and left key.
Camera can be the 3d camera with a plurality of minutes cameras, can be also circumscribed or internal fixed photographic head.
Camera can be infrared camera.
Can, with the illumination of light source opponent fingering row, in dark surrounds, use light source to throw light on.
Judge whether that the method that is positioned at working face is:
First determine working face.By analysis image, calculate distance or coordinate, and then definite planimetric position or equation, or camera is relative and the position of plane.Get camera coordinate system, on working face, get a little, calculate coordinate a little.Minimum not three points on straight line of getting, according to 3 principles of determining a plane, determine the Equation f of plane.Or get plane coordinate system, determine camera relatively and the position of plane.
Judge again whether finger tip is positioned on working face.Determine the position of finger fingertip, judge whether finger fingertip is positioned at working face.
If the position of camera and working face is fixed,, after calculating planimetric position, only need repeat to judge whether finger tip is positioned at plane.If changing appears in the position of camera,, after camera is static, repeat above-mentioned two steps, recalculate planimetric position, and judge whether finger tip is positioned at working face.
Utilize stereo vision method or principle of parallax to judge whether to be positioned at working face, generally include the steps such as Image Acquisition, camera calibration, feature extraction, images match, analytical calculation.The development of stereoscopic vision or parallax method is comparatively ripe, has many application, has several different methods can judge whether to be positioned at working face, does not enumerate here, provides two kinds of simplification, concrete computing method below.
The moving region of pointing in camera alignment work plane, a plurality of camera synchronous workings, take finger motion and working face background image continuously.The optical axis of two cameras is parallel, and inner parameter is consistent.From the image of camera, identify finger, and be based upon the corresponding relation of pointing in a plurality of camera image, because the angle of a plurality of cameras is different, in its image extracting, there is some difference for finger-image, the methods such as similarity that can distribute by correlativity or the feature of intensity profile find the part corresponding to each other, the corresponding part of finger tip in multiple image for example, then calculate finger such as the distance of finger tip and camera, and judge and point for example finger tip and whether be positioned on working face.
The computing method of finger and the distance of camera are as shown in Figure 2: establishing the imaging point of 1 P in space (x, y, z) in the identical video camera of two parallel placements is respectively (x
1, y
1), (x
2, y
2), knowing base length B, B is the distance of two camera optical axises, and in the situation of focal distance f, can calculate the distance of P point and imaging plane
Z=f×B／(x
2－x
1)=f×B／Δx
If the position of the relative working face of camera is fixed, picture point P ' on image (x ', y ') so, can be corresponding certain the object point P (x on keyboard, y), P ' is unique with the distance L of P, and fixing, on image, each picture point has corresponding L, before mouse performance, need to calculate the corresponding L of each picture point, as known quantity, be kept at mouse inside.Each pixel need to be preserved a vector [x, y, 1], if camera has n pixel, just preserves n vector.
If Z=L, P point is positioned on working face; Otherwise P point is not on working face.
If the relative position of camera and working face changes, after camera is static, by camera image is analyzed, find in plane three not three reference points point-blank, calculate the distance of reference point and camera, determine the equation of plane, then calculate finger such as the distance of finger tip and camera, thereby judge finger fingertip, whether be positioned in plane.
Another kind of computing method are as shown in Figure 3:
At grade, inner parameter is congenial for two cameras, and the distance of the projection centre line of two cameras is B, and focal length is f.If spatial point coordinate is P (x, y, z), the image of acquisition point P on the camera of left and right respectively, their coordinate is respectively P
1(x
1, y
1) and P
r(x
r, y
r).The image coordinate Y that P is ordered is identical, i.e. Y=y
1=y
r.In two images, D=x
1-x
r.Can calculate P point at the coordinate in space.
x=Bx
1／D；
y=By／D
z=Bf／D
By parallax method or 3D vision method, also have a lot, can use, similar approach does not repeat one by one at this.
The method that judges whether to be positioned at working face can be also two reference point methods:
Get in the plane two reference points, during work, take the image of reference point and impact point, from image, calculate two reference points and the distance of impact point on image, relatively, in the captured image of two cameras, whether distance is identical, if identical, impact point is positioned on working face; Or by the corresponding relation as with thing, go out the position of impact point from the position calculation of picture, if the position of the impact point that the image of taking from two cameras calculates is identical, impact point is positioned on working face, otherwise not in the plane.
Also can to whether pasting surface of keyboard with sciagraphy judgement finger, camera photographs the image of finger and shade thereof, analyzes the state of shade, whether judgement finger is positioned on working face, as whether finger tip shade is connected with finger tip, if so, finger plaster surface of keyboard; If not, finger does not have contact-key panel surface.
Parallel method of intersection refers to that camera optical axis is parallel with working face (as keyboard) or close to parallel, a plurality of cameras are positioned at working face edge, and position, higher than working face, can photograph the object of plane or plane top.First by the image of camera, whether judgement finger is pasting surface of keyboard, if while pasting surface of keyboard, the intersection point of the image of taking by a plurality of cameras, calculates the position of finger.The implementation method of parallel method of intersection has a variety of:
When object is during near surface of keyboard, its can be in the photosensitive material of camera, and at a narrow regional imaging that is parallel to surface of keyboard, this region is effective imaging region.When surface of keyboard is left in the position of object, in photosensitive material, effective imaging region is departed from the region of imaging, leaves surface of keyboard far away, and effectively imaging region is far away for distance.
When object is during near surface of keyboard, in the image that camera is clapped, subject image is arranged in the specific region of image, is called effective image area, and this region is wire or a long and narrow belt-like zone that is parallel to surface of keyboard normally.When object leaves surface of keyboard, Bu effective coverage, subject image position, leaves far, and it is far away that subject image departs from effective coverage.By analyzing finger-image, whether be positioned at effective image area, can judge finger, normally whether finger tip, contact keyboard.
Whether parallel method of intersection judgment object also can adopt other method at surface of keyboard, as passed through a trigger mechanism (as infrared light supply), launch and be similar to ultrared light, light (visible ray or invisible light) is parallel and pasting surface of keyboard, when surface of keyboard has object, object reflection ray, photosensitive material will receive reflection ray.Conversely, if photosensitive material receives this light, show to have object on surface of keyboard.
The image of the finger photographing by a plurality of cameras, the intersection point that image is corresponding, when known, can calculate the position of finger in camera position and parameter.A kind of computing method as shown in Figure 4:
x／(B-y)=f/y1
x/y=f/y2
From this equation, can calculate P point coordinate x, y.Wherein B is the distance of two cameras, y1, and y2 is the distance of P dot image in two cameras.
Parallel method of intersection calculating location also can adopt another kind of method, and as shown in Figure 5, two cameras and object P form a triangle, wherein the distance B of two cameras is known, by analyzing the image of two cameras, can determine angle α, θ, further can determine the position of P.
Parallel method of intersection also can or post reflection bar on keyboard, and light (visible ray or invisible light) is mapped on reflection bar, and reflection bar reflection ray forms a bright line on photosensitive material.When finger plaster surface of keyboard, light is blocked, and forms shade on reflection bar, what on photosensitive material, form is not just a bright line, but blocked by shade or finger the bright line that is cut into a section, according to the position of shade, can go out with trigonometric function the position of finger.By the variation of finger position, control cursor movement.If finger is not pasting surface of keyboard, on reflection bar, there is no shade, or reflection bar do not blocked, what at photosensitive material, form is exactly a bright line.The position of reflection bar is generally to paste surface of keyboard to install.
Or camera is taken the background of a little higher than surface of keyboard, when background is blocked by finger, show that finger plaster surface of keyboard, the position being blocked by background, calculates the position of finger.By the variation of finger position, control cursor movement.
Other method of parallel method of intersection calculating location does not enumerate.When object (as finger fingertip) is attached to working face (as keyboard) surface, calculate the position of object, then according to change in location, cursor is followed movement.
In a preferred version of the present invention, getting surface of keyboard is working face, get three buttons on keyboard: the upper right corner of the Ctrl in the esc key in the upper left corner, the F12 key in the upper right corner, the lower right corner is reference point, getting camera is coordinate system, calculate the coordinate of three reference points, and then the plane equation of definite surface of keyboard.In order to facilitate image characteristics extraction, can, with the word on three keys as reference point feature, also can use word directly as reference point.
In another preferred version of the present invention, getting surface of keyboard is working face, get two reference points on keyboard: the upper right corner of the esc key in the upper left corner, the F12 key in the upper right corner is reference point, mate the reference point in two camera image, the image that simultaneously mates two finger fingertips in the captured image of camera, in the image of taking respectively, measures the distance of finger tip and two reference points at two cameras, if corresponding distance is identical, finger tip is positioned on working face.Otherwise finger tip is not on working face.When getting reference point, reference point need to meet two conditions: 1, reference point is positioned on working face; 2, a finger fingertip lateral movement at two reference point lines.
For example, if finger (finger tip) is positioned on working face, for example, by difference or the motion conditions of the finger in two width consecutive images in same camera (finger tip) position, control the motion of cursor.
When many fingers are pasting surface of keyboard simultaneously and move, different move modes, can define different operations.For example left and right forefinger, represents downward page turning downwards simultaneously; Left and right forefinger oppositely moves, and represents amplifieroperation.
Accompanying drawing explanation:
The schematic diagram of the mouse that Fig. 1 and keyboard merge
1 left button
2 right buttons
3 cameras
4 cameras
The visual field of 5 left cameras
The visual field of 6 right cameras
7 finger holders
Fig. 2 computing method schematic diagram
The imaging plane of 1 left camera
The imaging plane of 2 right cameras
The camera lens of 3 left cameras
The camera lens of 4 right cameras
The optical axis of 5 left cameras
The optical axis of 6 right cameras
The another kind of computing method schematic diagram of Fig. 3
A kind of computing method schematic diagram of the parallel method of intersection of Fig. 4
The another kind of computing method schematic diagram of the parallel method of intersection of Fig. 5
Embodiment
The finger mouse 1 that embodiment 1 is combined with keyboard of notebook computer
This finger mouse application and notebook computer, comprise the following units:
Two cameras: the parameter of camera is identical, and optical axis is parallel.Camera is arranged in the frame of notebook computer screen top, becomes left and right to arrange.Camera is aimed at keyboard middle part downwards, during work, two cameras synchronously, take continuously shooting 100 two field pictures per second.
Left button, right button are positioned near key.backspace.
Surface of keyboard is level and smooth.
Surface of keyboard can be considered as a plane.
Refer to that holder is arranged on the position, space between two row's buttons adjacent on keyboard, refers to that holder has been the fixed support that props up finger effect, when finger motion, for palm provides support.
In three-dimensional system of coordinate, getting surface of keyboard is xoy, and screen rotation axle is x axle, and the keyboard upper left corner is initial point, and camera is positioned at one on the circumference of x axle rotation.For a notebook computer, position on notebook of its physics size, camera, the distance between two cameras etc. can be considered as constant, so the coordinate of camera in three-dimensional system of coordinate can calculate, according to the open angle of screen, can calculate the coordinate of camera in three-dimensional system of coordinate, the computing method of screen open angle size can be measured with an angular transducer; Also can on keyboard, get the object of reference of a size, location aware, when different angles, object of reference image size or position are different, before work, set up both corresponding relations, when work, the object of reference image that camera is taken, according to its size or position, obtain the angle of screen, further calculate the coordinate of camera.
User when opening notebook at every turn, and the angle of opening the angle that screen is opened and last time may be different, before using, recalculate the coordinate of camera so each.When work, the position of screen is normally fixed, and camera coordinate is constant.
The distance Z of each point of surface of keyboard and camera can be directly or indirectly calculated in above-mentioned calculating, by parallax method or 3D vision, calculates the distance L of finger tip and camera, Z=L, and finger tip is positioned at surface of keyboard.
Or get camera coordinate system, the reference point that the upper right corner of the Ctrl in the esc key in the upper left corner, the F12 key in the upper right corner, the lower right corner is surface of keyboard, calculate the distance of camera and reference point, obtain the plane formula of surface of keyboard, from image, find again finger tip, by parallax method, calculate finger tip coordinate, judge whether finger tip is positioned at plane.
User's keyboard operation and mouse action all complete on keyboard, and the motion of finger on keyboard is divided into three classes: 1, keystroke action: finger is motion from top to bottom, and direction and surface of keyboard are substantially vertical, meanwhile, the electric signal that generally a button is pressed; 2, effective action: finger plaster surface of keyboard and moved, a finger plaster surface of keyboard and is moved as cursor action, now, the mobile movement of controlling cursor of finger; When many finger plasters surface of keyboard and moved, according to different gestures, represent different operations, the meaning of gesture, can be self-defined.As two fingers move down simultaneously, represent that scroll bar moves down; Four fingers move down, and represent that window minimizes operation; Two finger move toward one another, represent to close a program; Two fingers move dorsad, represent to open a program.3, other actions: except vertical movement with pasting the movement surface of keyboard motion, this class action is usually user's habitual movement or action unintentionally.By the use habit to user, analyze, surface of keyboard is not being pasted in the action of user's operation keyboard and unintentionally action.
Mouse need to judge above-mentioned three kinds of user actions, specifically, is to identify the 2nd class, effective action.Determination methods is: whether judgement finger is pasting surface of keyboard, if the 2nd class effective action, mouse responds; To the first kind or the 3rd class invalid action, mouse will not respond.
Get in addition a time as invalid threshold value, further distinguish the 1st class action and the action of the 2nd class, while avoiding operation keyboard, there is maloperation in mouse.When finger is pressed keyboard, during constantly playing invalid threshold value from this, finger mouse stops response, and cursor keeps original position.Adopt invalid threshold value, when user on keyboard continuously, while pushing button fast, mouse quits work.Invalid threshold value value is 0.2 second, also can adjust according to user's use habit, such as getting 0.1 second or 0.5 second.Invalid threshold value can be used as a supplementary means, avoids at user key-press being, occurs maloperation.When user is during at key-press input word, within a short period, in 0.2 second, mouse can not respond.Or the motion that finger detected is while moving up and down, and in time threshold, cursor does not respond.
And in common keyboard, between each button, existing gap different, in the present invention, the surface of keyboard is level and smooth, so that the movement of finger.Simultaneously, between the two rows button of keyboard central authorities, the fixed support that props up finger effect has been installed, be called and refer to holder, when user's finger is when surface of keyboard moves, other finger can be placed on and refer in holder, this can be avoided other finger to push button mistakenly, and also the movement for finger provides the strong point and center of effort.Right and left key can be arranged on and refer to that holder is upper, with forefinger, middle finger or nameless operation, also can be arranged near the space bar of QWERTY keyboard, by thumb, is operated.
While using finger mouse, user's keyboard operation and mouse action all complete on keyboard, and when using keyboard input, user is by the upper and lower keystroke of normal mode, the same with the use-pattern of common keyboard; When using mouse, hand does not need to leave keyboard, and other finger is placed on and refers to that the upper maintenance of holder is static, and food root finger plaster surface of keyboard and moved, and cursor can move along with forefinger, and the mode of operation of right and left key is consistent with common mouse; While needing gesture operation, many finger plasters keyboard and are moved simultaneously, can carry out self-defining corresponding operating.
Finger mouse can replace the touch pad on notebook computer.
The finger mouse 2 that embodiment 2 is combined with keyboard of notebook computer
Comprise a camera, a light source, left button, right button.Camera is arranged on the centre position of the frame of notebook screen top, aims at keyboard central authorities; Light source is positioned at camera side, aims at keyboard; Right and left key is positioned near key.backspace.
Use sciagraphy judgement finger whether to contact with keyboard.During work, source alignment keyboard provides illumination, makes finger on keyboard, form shade.Camera is taken the consecutive image of finger motion, shooting 100 two field pictures per second, in each two field picture of taking at camera, identify the shade of finger and finger, further identify finger fingertip and shade thereof, on image, calculate the distance of finger tip and its finger tip of finger, if this distance is less than a threshold value or is 0, show that finger contacts with surface of keyboard.If finger contacts with keyboard, the change in location of pointing from two two field pictures of front and back, controls the motion of cursor on screen.
The finger mouse 1 that embodiment 3 is combined with computer-keyboard
As shown in Figure 1.
A support is installed on keyboard, and two parallel being installed on support of camera, aim at keyboard, and the position relationship of support and keyboard is known, and fixing, the present embodiment other side is with embodiment 1.
The finger mouse 2 that embodiment 4 is combined with computer-keyboard
Two circumscribed cameras are arranged in the frame of screen top of desktop computer, become left and right to arrange, and aim at keyboard, and the distance between camera is known quantity, and camera is connected with system by usb interface.In this example, the distance of camera and surface of keyboard is do not fix and change irregular, should go out keyboard planimetric position by technique computes such as three-dimensional measurement, three-dimensional reconstructions, and measure finger fingertip coordinate, three-dimensional measurement based on binocular vision, three-dimensional reconstruction be comparative maturity, does not enumerate herein.Judge whether finger tip is pasting surface of keyboard, if so, judge the motion conditions according to finger tip, control cursor movement.
Mouse right and left key is arranged near key.backspace, by thumb, is operated.
At present, the keyboard of desktop computer is separated with mouse and screen, and during operation, user's hand need to move around between keyboard and mouse, very inconvenient.The mouse apparatus of using on notebook computer is generally touching control rod or touch pad, and the volume that touching control rod takies is little, easy to carry, but use-pattern and conventional mouse difference are too large, uses inconvenience.The volume that touch pad takies is large, and it is in fact also separated with keyboard.Mouse disclosed by the invention and keyboard ideally merge, and do not take keyboard volume, very convenient to carry, and during use, hand does not need to leave keyboard, meanwhile, with finger, directly control the movement of cursor, more convenient than the use-pattern of conventional mouse.
The finger mouse that embodiment 5 is combined with panel computer external connection keyboard
When using panel computer work, often need to use external connection keyboard, now, use finger mouse, can remove common optical mouse, significantly improve portability and ease of use.
At the frame of panel computer, two cameras of built-in installation, the inner parameter of two cameras is consistent, and optical axis is parallel.An or 3D camera.Left mouse button right button is installed in the space bar outside of external connection keyboard, and on external connection keyboard left and right, to draw two small red dots be reference point at angle, and the angle of camera can be taken the image of whole keyboard range.During work, camera is taken finger and reference point image, measures the image distance of finger fingertip and reference point, if the distance of correspondence is identical in two cameras, finger fingertip is positioned at surface of keyboard.Further analyze consecutive image, the variation by finger tip at the relative position of consecutive image, controls the position of screen cursor and moves; If distance is different, do not make subsequent treatment.The function of left button right button is consistent with the function of common optical mouse.
The relative position of keyboard and panel computer can change.
The finger mouse 3 that embodiment 6 is combined with computer-keyboard
Two cameras that parameter is consistent are installed at keyboard edge, and one is positioned near F4 key, and one is positioned near F6 key, camera position, optical axis angle are fixed and are known, camera optical axis is slightly high and be close in surface of keyboard, and optical axis is parallel to surface of keyboard, and two camera optical axises are parallel to each other.Right and left key is positioned near key.backspace.
Because optical axis is parallel to surface of keyboard, and be close to surface of keyboard, so, the object of surface of keyboard images in center, effective image area is one and is parallel to surface of keyboard, is positioned at banded level (if the keyboard horizontal positioned) region of picture centre, and establishing it is highly 3 pixels.
In image, if while having image in the high effective image area of these 3 pixels, show that finger is at surface of keyboard, now, at two cameras, become in image, get the central point of finger-image, measure its position, can obtain the residing position of finger fingertip.
According to the variation of finger fingertip position, control the movement of cursor.The using method of right and left key is consistent with common mouse.
The above, it is only preferred embodiment of the present invention, not the present invention is done to any pro forma restriction, any those skilled in the art, do not departing within the scope of technical solution of the present invention, can utilize the method for above-mentioned announcement and technology contents to make a little change, but every content that does not depart from technical solution of the present invention, according to the technology of the present invention essence, to any simple modification made for any of the above embodiments, equivalent variations and modification, all belong in the scope of technical solution of the present invention.
Claims (10)
1. with finger, directly control the mouse apparatus of cursor for one kind, comprise one or more cameras, left button, right button, its method of work is, camera is taken the consecutive image of finger motion, by image is analyzed, judges finger whether pasting working face based on stereoscopic vision or principle of parallax or sciagraphy or two reference point methods, if, in the consecutive image of taking at camera, according to the change in location of finger-image, control cursor and do corresponding movement; If not, cursor does not move; Or adopt parallel method of intersection, whether judgement finger is pasting surface of keyboard, if so, calculates finger position, according to the movement of finger position, controls cursor movement.
2. mouse apparatus according to claim 1, is characterized in that: working face is surface of keyboard.
3. mouse apparatus according to claim 2, is characterized in that: surface of keyboard is level and smooth.
4. mouse apparatus according to claim 2, is characterized in that: on keyboard, between adjacent two row's buttons, install and refer to holder, refer to that holder has been the fixed support that props up finger effect.
5. mouse apparatus according to claim 1, is characterized in that: right and left key is positioned at and refers to that holder is upper, or is positioned near key.backspace.
6. mouse apparatus according to claim 1, is characterized in that: reflection bar is installed.
7. mouse apparatus according to claim 1, is characterized in that: camera is infrared camera, or with the 3D camera of a plurality of minutes cameras, or circumscribed camera, or embedded camera.
8. mouse apparatus according to claim 1, is characterized in that: with the illumination of light source opponent fingering row.
9. mouse apparatus according to claim 1, is characterized in that: when button being detected and be pressed, or finger is when move up and down, and gets a period of time threshold value, and in this threshold value, cursor does not respond, and time threshold value is 0.1 second-0.5 second.
10. mouse apparatus according to claim 1, is characterized in that: when many fingers are pasting surface of keyboard simultaneously and move, different move modes, defines different operations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410109161.4A CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410044519X | 2014-01-24 | ||
| CN201410044519.X | 2014-01-24 | ||
| CN201410044519 | 2014-01-24 | ||
| CN201410109161.4A CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104049747A true CN104049747A (en) | 2014-09-17 |
| CN104049747B CN104049747B (en) | 2017-02-08 |
Family
ID=51502715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410109161.4A Expired - Fee Related CN104049747B (en) | 2014-01-24 | 2014-03-17 | Mouse device for directly controlling cursor with finger |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104049747B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104991648A (en) * | 2015-07-20 | 2015-10-21 | 江苏惠通集团有限责任公司 | Screen input system |
| CN106020519A (en) * | 2016-07-14 | 2016-10-12 | 胡世曦 | Novel mouse |
| CN106066704A (en) * | 2016-06-04 | 2016-11-02 | 胡世曦 | A kind of mouse using radio-frequency technique |
| CN109983764A (en) * | 2016-11-21 | 2019-07-05 | 精工爱普生株式会社 | Projecting apparatus system |
| CN117472189A (en) * | 2023-12-27 | 2024-01-30 | 大连三通科技发展有限公司 | Typing or touch control realization method with physical sense |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030132913A1 (en) * | 2002-01-11 | 2003-07-17 | Anton Issinski | Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras |
| CN101776953A (en) * | 2009-12-29 | 2010-07-14 | 胡世曦 | Optical positioning method and finger mouse integrated with keyboard |
| CN103487938A (en) * | 2013-08-28 | 2014-01-01 | 成都理想境界科技有限公司 | Head mounted display |
-
2014
- 2014-03-17 CN CN201410109161.4A patent/CN104049747B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030132913A1 (en) * | 2002-01-11 | 2003-07-17 | Anton Issinski | Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras |
| CN101776953A (en) * | 2009-12-29 | 2010-07-14 | 胡世曦 | Optical positioning method and finger mouse integrated with keyboard |
| CN101963848A (en) * | 2009-12-29 | 2011-02-02 | 胡世曦 | Method for determining if target point belong to plane, mouse and touch screen |
| CN103487938A (en) * | 2013-08-28 | 2014-01-01 | 成都理想境界科技有限公司 | Head mounted display |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104991648A (en) * | 2015-07-20 | 2015-10-21 | 江苏惠通集团有限责任公司 | Screen input system |
| CN104991648B (en) * | 2015-07-20 | 2018-05-11 | 江苏惠通集团有限责任公司 | Screen input system |
| CN106066704A (en) * | 2016-06-04 | 2016-11-02 | 胡世曦 | A kind of mouse using radio-frequency technique |
| CN106020519A (en) * | 2016-07-14 | 2016-10-12 | 胡世曦 | Novel mouse |
| CN109983764A (en) * | 2016-11-21 | 2019-07-05 | 精工爱普生株式会社 | Projecting apparatus system |
| CN117472189A (en) * | 2023-12-27 | 2024-01-30 | 大连三通科技发展有限公司 | Typing or touch control realization method with physical sense |
| CN117472189B (en) * | 2023-12-27 | 2024-04-09 | 大连三通科技发展有限公司 | Typing or touch control realization method with physical sense |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104049747B (en) | 2017-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110308789B (en) | Method and system for mixed reality interaction with peripheral devices | |
| US10324566B2 (en) | Enhanced interaction touch system | |
| US9268413B2 (en) | Multi-touch touchscreen incorporating pen tracking | |
| US8842076B2 (en) | Multi-touch touchscreen incorporating pen tracking | |
| KR102335132B1 (en) | Multi-modal gesture based interactive system and method using one single sensing system | |
| KR101851264B1 (en) | System and Method for a Virtual Multi-touch Mouse and Stylus Apparatus | |
| CN101776953A (en) | Optical positioning method and finger mouse integrated with keyboard | |
| US10452206B2 (en) | Projection video display device and video display method | |
| US9494415B2 (en) | Object position determination | |
| US20120249422A1 (en) | Interactive input system and method | |
| US9454260B2 (en) | System and method for enabling multi-display input | |
| CN104049747A (en) | Mouse device for directly controlling cursor with finger | |
| US9213440B2 (en) | System and method for remote touch detection | |
| CN102520799A (en) | Projection keyboard | |
| US20170170826A1 (en) | Optical sensor based mechanical keyboard input system and method | |
| JP6528964B2 (en) | INPUT OPERATION DETECTING DEVICE, IMAGE DISPLAY DEVICE, PROJECTOR DEVICE, PROJECTOR SYSTEM, AND INPUT OPERATION DETECTING METHOD | |
| CN102163092B (en) | Finger mouse | |
| TW201342158A (en) | Optical touch sensing apparatus | |
| TW201409286A (en) | Keyboard device and electronic device | |
| JP2013134549A (en) | Data input device and data input method | |
| US20130265283A1 (en) | Optical operation system | |
| KR102101565B1 (en) | Media display device | |
| TW201349056A (en) | High resolution and high sensitivity optically activated cursor maneuvering device | |
| KR20130136314A (en) | Touch panel apparatus | |
| KR20100109747A (en) | Non-contact mouse device and method of using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170208 |