CN101963848B - Method for determining if target point belong to plane, mouse and touch screen - Google Patents
Method for determining if target point belong to plane, mouse and touch screen Download PDFInfo
- Publication number
- CN101963848B CN101963848B CN201010297546.XA CN201010297546A CN101963848B CN 101963848 B CN101963848 B CN 101963848B CN 201010297546 A CN201010297546 A CN 201010297546A CN 101963848 B CN101963848 B CN 101963848B
- Authority
- CN
- China
- Prior art keywords
- point
- screen
- plane
- image
- keyboard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
Abstract
The invention discloses a method for determining if a target point belongs to a plane, a mouse and a touch screen. The method comprises that: two or more than two cameras are aims at the target point on the plane or on one of the two sides of the plain and take images of the target points; if the same image point positions of the target point corresponding to the cameras are the same, the point is determined to belong to the plane; and the same image point positions of the target point corresponding to the cameras are different, the point is determined not to belong to the plane. A finger mouse fused with a keyboard. The mouse and the keyboard are fused together perfectly. When using the mouse, a user does not need to wear any other additional equipment on fingers, but directly move the finger on the surface of the keyboard without leaving the keyboard for controlling the cursor on a screen to move. Thus, the user can use the keyboard and the mouse directly. The optical touch screen is low in cost and can position accurately.
Description
Technical field:
The present invention relates to a kind of judge whether impact point belongs to planar approach, and then finger mouse and touch-screen methods and applications the method and keyboard fusion to object location.
Background technology:
Since operating system enters graphic user interface, owing to need to cursor shown on display (cursor) being controlled, so mouse become except keyboard, one of most important peripheral input media.
Optical mouse (optical mouse) is often to utilize COM, PS/2 or USB interface to interconnect with intercomputer, and on display, shown cursor can move and move along with optical mouse.
The structure of existing optical mouse comprises housing, light emitting diode, optical lens, light-receiving treating apparatus, button and printed circuit board (PCB), light emitting diode is arranged in housing, and towards an opening emission of light of housing bottom, therefore after this optical mouse is placed on desktop or mouse pad, light be irradiated on desktop or mouse pad can reflection ray,, optical lens is used for assembling that autoluminescence diode is launched and by the reflection ray of desktop or mouse pad reflection.Light-receiving treating apparatus receives the reflection ray after optical lens is assembled, and light-receiving treating apparatus has optical sensor unit and a graphics processing unit; Optical sensor unit is made up of Charged Coupled Device (CCD), therefore can obtain the image after assembling via optical lens, typical light processor chip is the optical mouse such as HDNS-2000, the HDNS-2051 dedicated optical receiving and processing device chip of AGILENT company of the U.S., and such light-receiving treating apparatus chip is as per second in HDNS-2000 cake core can pick up 1500 two field pictures from sensitization window.Then, the image being extracted at different time for optical sensor by graphics processing unit is compared its difference place, judge thus displacement, speed etc. that mouse moves, and be converted into the corresponding coordinate of computing machine (Δ X, Δ Y) electric signal after deliver on computing machine, to control the movement of cursor.
When the button of mouse, while being pressed by user, the button microswitch that can link, click (click) action to control cursor, because optical mouse is to adopt optical technology to carry out the judgement of shift position, therefore have and be difficult for being infected with the advantages such as dust, resolution is high, movement is smooth, therefore replace gradually the idler wheel mouse of traditional type.
But, the user of optical mouse needs certain space to grip mouse along a planar movement, could effectively control cursor movement, therefore quite a lot of space must account for, not very convenient in use, especially for the notebook computer of usually carrying, require it as far as possible light, small and exquisite, mouse can take certain space or weight, convenient not when carrying, using.
If both needed typewriting, while needing to use mouse again, user's hand has to move around between keyboard and mouse, and this can reduce user's work efficiency.
The person of being even more important, long-time operation rolling mouse not only easily makes the muscular fatigue at wrist position and finger-joint ache, and seriously more may cause athletic injury because of long-term accumulated.
Touch-screen is as a kind of up-to-date computer input apparatus, and it is the simplest, convenient, natural a kind of man-machine interaction mode at present.The range of application of touch-screen is boundless, is mainly the inquiry of public information; As the service inquiry of the departments such as telecommunication bureau, the tax bureau, bank, electric power; The information inquiry in street corner, city; In addition be applied to leader's office, Industry Control, military commanding, electronic game, choosing song or selecting dish, multimedia teaching, real estate presell etc.
Distinguish touch-screen from know-why, can be divided into five basic kind: vector pressure sensing technology touch-screen, resistive technologies touch-screen, capacitance technology touch-screen, infrared technology touch-screen, surface acoustic wave technique touch-screen.Wherein vector pressure sensing technology touch-screen steps down from the stage of history; Infrared technology touch-screen is cheap, but its housing is frangible, easily produces light and disturbs, distortion in curved surface situation; Capacitance technology touch screen design reasonable idea, but its image fault problem is difficult to be solved at all; The accurate positioning of resistive technologies touch-screen, but its price is quite high, and be afraid of to scrape rapid wear; Surface acoustic wave touch screen has solved the various defects of touch-screen in the past, is clearly not easy damagedly, is suitable for various occasions, has if shortcoming is screen surface blunt that water droplet and dust can make that touch-screen becomes, and does not even work.
The major part of electric resistance touch screen is a resistance film screen coordinating very much with display surface, this is a kind of laminated film of multilayer, it is using one deck glass or duroplasts flat board as basic unit, surface scribbles layer of transparent oxidized metal (transparent conductive resistance) conductive layer, is stamped one deck outside surface cure process, smooth anti-friction plastic layer above, its inside surface also scribbles one deck coating, between them, has the transparent isolating points of many tiny (being less than 1/1000 inch) that two conductive layers is separated to insulation again.In the time of finger touch screen, two conductive layers has just had contact in position, touch point, resistance changes, on X and Y both direction, produce signal, then send touch screen controller, controller detects this contact and calculates the position of (X, Y), then operates according to the mode of analog mouse.
Capacitance touch screen is four layers of compound glass screen; the inside surface of glass screen and interlayer respectively scribble one deck ITO, and outermost layer is skim silicon soil glassivation, and interlayer ITO coating is as workplace; on four angles, draw four electrodes, internal layer ITO is that screen layer is to ensure good working environment.In the time that finger touch is on metal level, due to people's bulk electric field, user and touch screen surface form with a coupling capacitance, and for high-frequency current, electric capacity is direct conductor, so finger siphons away a very little electric current from contact point.This electric current divides in the electrode four jiaos from touch-screen and flows out, and the electric current of these four electrodes of flowing through is directly proportional to the distance of four jiaos to finger, and controller, by the accurate Calculation to these four current ratios, draws the position of touch point.
Capacitance plate is reflective serious, and four layers of compound touch-screen of capacitance technology are inhomogeneous to the transmittance of each wavelength light, have the problem of color distortion, because light is in the reflection of each interlayer, also cause the fuzzy of image character.Electrode that capacitance plate is used as human body as a capacitor element in principle uses, when have conductor near and interlayer ITO workplace between while being coupled out the electric capacity of q.s capacitance, the electric current flowing away just enough causes the misoperation of capacitance plate.When larger area palm or hand-held conductor thing just can cause the misoperation of capacitance plate near capacitance plate instead of while touching, in wet weather, this situation is particularly serious, hand steered live display, palm near 7 centimetres of displays with interior or health near 15 centimetres of displays with the interior misoperation that just can cause capacitance plate.When another shortcoming of capacitance plate touches with glove hand or hand-held nonconducting object, do not react, this is because increased the more medium of insulation.The main shortcoming of capacitance plate is drift: in the time that environment temperature, humidity change, when environment of electric field changes, all can cause the drift of capacitance plate, cause inaccurate.For example: after start, display temperature rising can cause drift: when user's touch screen, another hand or health one side can be drifted about near display; Near capacitance touch screen, larger object returns drift after moving, and also can cause drift if having people to enclose when you touch to watch; The drift reason of capacitance plate belongs to technical inadequate natural endowment, environment potential surface (comprising user's health) although with capacitance touch screen from away from must be, than large many of finger area, they have directly affected the mensuration of touch location.
Infrared touch panel is to utilize infrared ray matrix densely covered in X, Y-direction to detect the also touch of consumer positioning.Infrared touch panel is installed above a circuit board housing display, circuit board arrange on screen four limits infrared transmitting tube and infrared receiving tube, the one by one corresponding infrared ray matrix anyhow intersecting that forms.User is in the time of touch screen, and finger will block two infrared rays anyhow through this position, thereby can judge the position of touch point at screen.Any touch object all can change the infrared ray on contact and realize touch screen operation.
X is being pasted respectively at three angles of surface acoustic wave touch screen, the transducer that the transmits and receives sound wave (transducer: be made up of special ceramic materials, be divided into transmitting transducer and receiving transducer of Y-direction.That electric signal that controller is sent here by touch-screen cable is converted into sound wave energy and the surface acoustic wave that pooled from reflection strip can become electric signal.), the hyperacoustic reflection strip of reflecting surface is being carved on four limits.When finger or soft object touch screen, acoustic wave segment energy is absorbed, so changed reception signal, obtains the X of touch, Y coordinate through the processing of controller.
Optical touch screen: the CCD camera that is arranged on the top of screen upper left corner, launch light by LED lamp, through the reflection of surrounding reflection bar, enter in the CCD camera in the upper right corner. in like manner, the light of the CCD camera transmitting in the upper right corner imports in the CCD camera in left side. and densely covered light forms a reticule in touch area, and the space between the process light of multiple reflections is in 1MM.In time that touch is a bit, the ejaculation light of this point and reception light group are in an angle, the straight line simultaneously forming between the CCD camera at two ends and this two light and two cameras can form again two angles, and the accurate coordinate of this point, by controller typing, is realized and touched reaction like this.
Summary of the invention:
The object of the invention is to openly a kind ofly judge whether a point belongs to the method for a plane, and use mouse apparatus and the touch panel device of the method; Avoid the weak point of existing mouse, a kind of novel mouse apparatus that merge with keyboard, directly control cursor movement on indicator screen with the movement of finger is provided, make computer control convenient, thus more practical; Make that touch-screen cost is low, accurate positioning, screen intensity is not affected.
The object of the invention can realize by following technology: a kind of for judging whether an impact point belongs to the method for a plane, two or more cameras are taken the impact point of in plane and plane both sides, the image that image identification unit photographs from above-mentioned camera, identify the image of impact point, if the position of the same picture point of the corresponding different cameras of impact point is identical, this impact point belongs to this plane, otherwise this impact point is positioned at the both sides of plane.
Described for judging whether an impact point belongs to the method for a plane, the whether identical method in position that judges the same picture point of the corresponding different cameras of impact point has following two kinds: the image stack that a takes multiple cameras relatively, if the picture position of impact point overlaps, show that position is identical, otherwise, position difference; B is according to the corresponding relation of physical location in the position of imaging point and plane, and the position from the picture of impact point image, calculates it with picture point physical location in the plane, the position of the same picture point that the image of relatively taking from multiple cameras calculates.
A kind of mouse apparatus, comprises left button, right button, it is characterized in that: comprising:
Two or more cameras: the moving object to working face and working face top is taken; Image identification unit: for identify the image of moving object from working face background image;
Judging unit: for judging whether moving object contacts with working face;
Computing unit: if moving object contacts with working face, calculate the speed of motion of the picture of contact site or the speed that contact site moves along working face;
Control communication unit: the speed of moving of the speed that contact site is moved along working face or contact site image and left button, right button keystroke information send host computer system to, control moving or carrying out associative operation of cursor on screen.
Described mouse apparatus, described in it, moving object is user's finger.
Described mouse apparatus, described in it, working face is surface of keyboard.
Described mouse apparatus, described in it, surface of keyboard is level and smooth.
Described mouse apparatus, has been provided with between adjacent two row's buttons on keyboard described in it and has propped up finger effect and refer to hold in the palm.
Described mouse apparatus, its left button, right button are positioned at and refer to that holder is upper, or are positioned in QWERTY keyboard near space bar.
A kind of touch-screen, it comprises:
Two or more cameras: for the moving object of screen surface and screen one side is taken;
Image identification unit: for identify the image of moving object from screen background image;
Judging unit: whether contact with screen surface for judgment object;
Computing unit: if object contacts with screen surface, calculate contact site with respect to the position of object of reference and the coordinate on screen, or the speed of the motion at object contact position;
Control module: according to the speed of object contact portion bit position or motion, carry out corresponding operation.
Described touch-screen, taking the edge of screen as object of reference.
The present invention compared with prior art, avoid the weak point of existing mouse, a kind of novel mouse apparatus that merge with keyboard, directly control cursor movement on indicator screen with the movement of finger is provided, makes computer control convenient, thus more practical; Make that touch-screen cost is low, accurate positioning, screen intensity is not affected.
Brief description of the drawings
Fig. 1 is the method schematic diagram whether judging point of the present invention belongs to plane;
Fig. 2 is the image schematic diagram that camera 2 of the present invention is taken;
Fig. 3 is the image schematic diagram that camera 1 of the present invention is taken;
Fig. 4 is of the present invention and the schematic diagram of the finger mouse of keyboard fusion;
Fig. 5 is touch-screen schematic diagram of the present invention;
Fig. 6 is the system schematic that simultaneously possesses mouse and touch-screen of the present invention.
Number in the figure explanation: 1 is camera, and 2 is camera, and 3 is a little, and 4 is the same picture point of camera 2,5 is the same picture point of camera 1, and 6 is object of reference, and a, b, c are three reference points on object of reference, and 11 is screen object of reference, 10 is keyboard object of reference, and 7 for referring to holder, and 8 is left button, and 9 is right button.
A point in kind in space, the imaging point on the photoactive substance of camera is called picture point, a spatial point and a point being positioned in plane, if their imaging point position is identical, the point in plane is called the same picture point of spatial point.The position that belongs to the same picture point of point in plane and its correspondence is actually coincidence, and point and its physical location with picture point of being positioned at plane both sides do not overlap.When point position in space is during in plane both sides, its position with picture point position in the plane and camera is relevant, two cameras that position is different, and the same picture point of corresponding these two cameras of this spatial point position is in the plane different.Position with picture point is also relevant with the position of plane, and same point is also different corresponding to the position of the same picture point in Different Plane of same video camera.
Position in the plane of point refers to the relative position of itself and object of reference.The position of picture point is the relative position of picture point with respect to the picture of object of reference.Object of reference is positioned in plane, must comprise at least 3 not points point-blank, and these 3 points can be determined the position of plane.Object of reference can be tangible mark, as the pattern in the texture of plane or plane; Also can be a virtual mark.While using tangible mark, the image space of object of reference can draw by the method for image recognition.While using virtual object of reference, the physical location of virtual object of reference should be known, and the position of the picture of virtual object of reference can be calculated theoretically, if the position of virtual object of reference is not known, or cannot calculate its image space, can not serve as object of reference.Virtual signage has multiple, for example: mark in the plane a fixing perform region, calculate the image space of this edges of regions and the physical location of edges of regions, as object of reference.
As shown in Figure 1, take with 1,2 pairs of points 3 of two cameras, on the face of making even, certain is masked as object of reference 6, and this mark comprises at least 3 not some a, b, c on same straight line.4,5 is respectively the same picture point of point 3 corresponding cameras 2,1.From Fig. 2, Fig. 3 can find out, point 4, point 5 are different with respect to the position of object of reference 6.
The corresponding imaging point of each point in plane, the position of planar point and the position of imaging point are one to one, when the position of camera is fixed, position corresponding relation is also changeless, can calculate in advance or measure; When the position of camera changes, position corresponding relation also changes, and now, calculate corresponding relation, need to get in the plane object of reference, and object of reference at least comprises not three points point-blank, and its position and size are known and constant.First camera is placed on to normal place, object of reference is taken, standard picture position with reference to thing is recorded, then, in the time of the change in location of camera, object of reference is taken pictures and is recorded the position of the picture of object of reference, and and the comparison of marker picture position, thereby calculate the position corresponding relation of picture point and actual point.According to position corresponding relation, can go out from the position calculation of picture point the position of same picture point.
The image that graphics processing unit photographs from camera, identify the image of impact point, according to their position corresponding relation, the same picture point that calculates impact point position in the plane, if the position of the same picture point calculating the image of taking from above-mentioned camera is all identical, that is to say: the same picture point corresponding from different cameras of impact point position is in the plane identical, this point belongs to this plane, otherwise this point is positioned at plane both sides.
Or, image identification unit identifies after the image of impact point, by the image stack of multiple cameras, whether the picture position of comparison object point overlaps, if overlap, show: the same picture point corresponding from different cameras of impact point position is in the plane identical, and this impact point is positioned in plane, otherwise this point is positioned at plane both sides.
A kind of mouse apparatus, comprises left button, right button; Also comprise following component parts:
Two or more cameras: the moving object to working face and working face top is taken; Be masked as object of reference with certain on working face, object of reference at least comprises three not points point-blank;
Image identification unit: the image that identifies moving object from working face background image;
Whether judging unit: whether the same image point position by moving object in more multiple cameras is identical, judge moving object and contact with working face;
Computing unit: if moving object contacts with working face, calculate the movement velocity of picture or the actual motion speed of contact site of contact site.
The movement velocity of calculating picture is fairly simple, directly image is carried out to simple measurement and computing.
Calculate the actual motion speed more complicated of object: according to the corresponding relation of the physical location of the position of contact site picture and contact site, calculate the physical location of contact site, further calculate the displacement of contact site in a period of time interval, thereby calculate the speed that contact site moves along working face; The position of picture and physical location are one to one, and the account form of corresponding relation has two kinds:
If the parameters of camera and all fixing with relative position, the relative height of working face, as position and the corresponding relation of contact site physical location be a constant, disposablely calculate or measure corresponding relation, can be used as constant and use.
If the parameter of camera and not fixing with relative position, the relative height of working face, as position and the corresponding relation of physical location change, in this case, the size of object of reference and position must be known constant, first measure the size of object of reference and the numerical value of position, draw again the size of picture and the numerical value of position of object of reference by the method for image recognition, draw physical location and the size and the position of picture and big or small proportionate relationship of object of reference.Next show that by image recognition the picture of contact site is with respect to size and the position of the picture of object of reference, the proportionate relationship drawing according to previous step, calculates the physical location of contact site on working face.
Control communication unit: the movable information that contact site is moved along working face and right and left key keystroke information send host computer system to, control moving or carrying out associative operation of cursor on screen, if moving object has multiple, the different motion state of multiple moving objects represents different operations.
A kind of touch-screen, comprises following parts:
Two or more cameras, take the moving object of screen surface and screen one side; Be masked as object of reference with certain on screen, as the edge of screen;
Image identification unit: the image that identifies moving object from screen background image;
Judging unit: whether judgment object contacts with screen surface;
Computing unit: if moving object position contacts with working face, according to the corresponding relation of the physical location of the position of contact site picture and contact site, calculate the physical location of contact site, further calculate the displacement of contact site in a period of time interval, thereby calculate the speed that contact site moves along screen surface; The position of picture and physical location are one to one, have two kinds according to the account form of the position calculation physical location of picture:
If the parameters of camera and with relative position, the relative height of working face be all fixing, as position and the corresponding relation of physical location be a constant, corresponding relation once calculates or measures, and can repeatedly use.
If the parameter of camera and not fixing with relative position, the relative height of working face, as position and the corresponding relation of physical location change, in this case, the size of object of reference and position must be known constant, first measure the size of object of reference and the numerical value of position, draw again the size of picture and the numerical value of position of object of reference by the method for image recognition, draw physical location and the size and the position of picture and big or small proportionate relationship of object of reference.Next show that by image recognition the picture of contact site is with respect to size and the position of the picture of object of reference, the proportionate relationship drawing according to previous step, calculates the physical location of moving object in screen surface.
Control module: according to the position of object or movement velocity, carry out corresponding operation.
Embodiment
The finger mouse that embodiment 1 is combined with keyboard, as shown in Figure 4:
Comprise the following units:
Two camera cameras 1, camera 2: the movement to surface of keyboard and keyboard top finger is taken, camera slightly exceeds surface of keyboard, position is positioned at the top of QWERTY keyboard function key, the top of ' F ' and ' J ' key, camera is aimed at the central authorities of keyboard, visual field overlay keyboard middle section.Two camera synchronous workings, their parameter is identical, when work, the parameters of camera is fixed, as the direction of optical axis, focal length, position, height etc.
Image identification unit: identify the image of finger and the image of object of reference from keyboard background image, the parameter of camera is fixed, so, the background image of keyboard is a constant, can not change, meanwhile, the shape of user's finger is also roughly the same, so the image that identifies finger from keyboard background image is very easy to.Conventionally, the position that finger contacts with surface of keyboard is finger tip, finger tip is generally positioned at and approaches the position of camera or the position of close keyboard most, finger tip has obvious feature, as nail, contour edge etc., according to these features, image identification unit further identifies the image of finger tip from finger-image, and finding corresponding point or corresponding position, corresponding point to refer to a point in kind imaging point in two cameras respectively, multiple corresponding point form corresponding position.By follow-up unit, the corresponding point on finger tip are processed.Image recognition technology is quite ripe at present, does not repeat them here.
Judging unit: judge whether finger contacts with surface of keyboard.Taking the numerical key ' 6 ' of QWERTY keyboard top, ' T ' and ' Y ' as object of reference, position and the parameter of camera are fixed, so its imaging point position and physical location are also fixed, can be considered constant.
The motion of finger on keyboard is divided into three classes: 1, keystroke action: finger is motion from top to bottom, and direction and surface of keyboard are substantially vertical, meanwhile, the electric signal that generally a button is pressed; 2, effective action: finger plaster surface of keyboard and moved, a finger plaster surface of keyboard and is moved as cursor action, now, the mobile movement of controlling cursor of finger; When many finger plasters surface of keyboard and moved, according to different gestures, represent different operations, the meaning of gesture, by User Defined.As two fingers move down simultaneously, represent that scroll bar moves down; Four fingers move down, and represent that window minimizes operation; Two finger move toward one another, represent to close a program; Two fingers move dorsad, represent to open a program.3, other actions: except vertical movement with pasting the movement surface of keyboard motion, this class action is usually user's habitual movement or action unintentionally.
In the time that the finger tip of finger is positioned at surface of keyboard, the position (with respect to the position of object of reference) of the same picture point of corresponding two cameras of finger tip part (or finger tip corresponding point) that contact is identical; If higher than surface of keyboard, finger tip is corresponding to the position difference of the same picture point of two cameras, whether identical according to the same image point position of the different cameras of the correspondence of finger tip picture (or finger tip corresponding point), judging unit can be judged finger tip and whether paste surface of keyboard.If it is 1 keystroke action or 3 other actions that finger tip not at surface of keyboard, shows the action of finger, now, mouse system is left intact.If finger tip is attached to surface of keyboard, and do not have the electric signal that a button is pressed, show that the action of finger belongs to 2 effective actions, the computing unit of mouse is started working.
Computing unit: calculate the speed that finger fingertip moves along surface of keyboard, comprise speed and direction.Same camera is in the image of two moment shootings, and the distance of the picture (or finger tip corresponding point) of finger fingertip, divided by the time interval in two moment, calculates the movement velocity of the picture of finger fingertip, thereby calculates the movement velocity of finger fingertip.
Control communication unit: the motion velocity information of finger finger tip, the keystroke information of gesture information and right and left key sends to host computer system, carries out operation accordingly.
And in common keyboard, between each button, there is gap difference, in the present invention, the surface of keyboard is level and smooth, so that the movement of finger.Simultaneously, between the two rows button of keyboard central authorities, the fixed support that props up finger effect is installed, be called and refer to holder, when user's finger is in the time that surface of keyboard moves, other finger can be placed on and refer in holder, this can be avoided other finger to push button mistakenly, also for the movement of finger provides the strong point and center of effort.Right and left key can be arranged on and refer to that holder is upper, with forefinger, middle finger or nameless operation, also can be arranged near the space bar of QWERTY keyboard, is operated by thumb.
In the time using keyboard input, user is by the upper and lower keystroke of normal mode, the same with the use-pattern of common keyboard; In the time using mouse, hand does not need to leave keyboard, and other finger is placed on and refers to that the upper maintenance of holder is static, and a certain finger plaster surface of keyboard and moved, and cursor can move along with finger, and the mode of operation of right and left key is consistent with common mouse; While needing gesture operation, many finger plasters keyboard and are moved simultaneously, can carry out self-defining corresponding operating.
At present, the keyboard of desktop computer separates with mouse, and when operation, user's hand need to move around between keyboard and mouse, very inconvenient.The mouse apparatus of using on notebook computer is generally touching control rod or touch pad, and the volume that touching control rod takies is little, easy to carry, but use-pattern and conventional mouse difference are too large, use uncomfortable.The volume that touch pad takies is large, and it in fact also separates with keyboard.Mouse disclosed by the invention and keyboard ideally merge, and do not take keyboard volume, very convenient to carry, and when use, hand does not need to leave keyboard, meanwhile, directly control the movement of cursor with finger, more convenient than the use-pattern of conventional mouse.
Comprise two cameras, the position of camera is on two angles above screen, and the height of camera exceeds screen surface, and its visual field has covered whole screen.The parameters of camera is all fixed, as focal length, and the orientation of optical axis, highly, position etc.Taking at least two of screen crossing edges as object of reference, the image space of object of reference and physical location are all fixing, can be considered constant.Camera is taken the image of screen surface and screen one side, two camera synchronous workings.
Image identification unit identifies the image of object (touch body) from the background image of screen, determines corresponding point in the image of two cameras.The background image of screen is the normal image showing on screen, be generally change and be positioned at screen surface, and subject image is except surface of contact, all the other are all sides that is positioned at screen, background image and subject image can be distinguished according to this feature.
Judging unit: whether judge object and contact with screen, if object does not contact with screen, the relative position of the same picture point of corresponding two cameras of object (object of reference relatively) is not identical; If object contacts with screen, the object in corresponding two cameras is identical with image point position.
Computing unit: calculate the speed that moving object is moved along screen surface, comprise speed and direction, in the time having multiple object contact, calculate respectively its position and speed.
Control communication unit: the motion velocity information of moving object, multi-point touch information sends to host computer system, carry out operation accordingly.
Mouse and touch-screen are input equipments common on computing machine, in above-mentioned two embodiment, the principle that mouse is used with touch-screen is consistent, and its main parts are also identical, so they can merge in a cover system, namely a cover system has touch-screen and mouse function simultaneously.
On two angles above notebook computer screen, two cameras are installed, the height of camera exceeds screen surface, its cover screen surface, visual field and keyboard, the each point on screen and keyboard can be guaranteed to be photographed by two cameras.Two cameras are taken the object of screen surface and screen one side and surface of keyboard and keyboard top, two camera sync photographies.
Surface of keyboard is level and smooth, to facilitate the movement of finger, gap between two rows button is installed and is referred to holder, refer to that holder has been the fixed support that props up finger effect, when user's finger is in the time that surface of keyboard moves, other finger can be placed on and refer to that holder is upper, can avoid like this other finger to push button mistakenly, also for the movement of finger provides the strong point and center of effort.Right and left key can be arranged on and refer to that holder is upper, with forefinger, middle finger or nameless operation, also can be arranged near the space bar of QWERTY keyboard, is operated by thumb.
Image identification unit identifies the image of finger from screen and keyboard background, and the image of different user finger does not have too large difference, so the success ratio of identification is very high.
Using the edge of screen as screen object of reference, using the power lights of surface of keyboard, ' F3 ' and ' F6 ' key as keyboard object of reference.The physical location of these two objects of reference is different with the computing method of image space: because camera is with respect to the position of screen with highly all fix, so image space and the size of screen object of reference on camera photoactive substance is fixing, directly use once just can regard constant as after determining.Its physical location and size are also fixed, and can be used as constant and use.Because the screen of notebook computer can folding, so the position of camera changes with respect to keyboard, therefore the image space of keyboard object of reference on camera photoactive substance and size also change, its concrete image space and big or small by image identification unit Real time identification, and calculate.The physical location of keyboard object of reference and size are constants, can measure in the production debug phase.
Judging unit, the action type of judgement finger.Identifying after finger-image, first calculate the relative position of finger-image (normally finger tip) with respect to the same picture point of keyboard, if the position of the same picture point with respect to keyboard object of reference of corresponding two cameras is identical, show that finger is at surface of keyboard, if the electric signal that does not now have keyboard to be pressed, shows that finger is at operating mouse; If the position difference of the same picture point with respect to keyboard object of reference of corresponding two cameras, continue and the comparison of screen object of reference, if the relative position of the same picture point with respect to screen object of reference of corresponding two cameras of finger (normally finger tip) is identical, show that finger is at operation touch-screen; Otherwise finger, neither operating mouse neither operation keyboard.
Computing unit, if finger is operating mouse, calculates the movement velocity that finger (normally finger tip) is pasting surface of keyboard; If finger is operation touch-screen, calculate finger (normally finger tip) in the position of screen surface and the movement velocity of finger (normally finger tip).
Communication and control module, the movable information of finger, gesture information and right and left key click information send to host computer system, if finger is operating mouse, cursor moves along with finger, or according to self-defining gesture implication, carries out corresponding gesture operation; If finger is operation touch-screen, carries out screen touch and put locational program function, or according to self-defining gesture implication, carry out corresponding gesture operation.
One cover system has been realized two functions, and existing touch-screen also has mouse, so have very high cost performance.Keyboard and mouse combine, and make user's use and more convenient to operate.
Claims (9)
1. one kind for judging whether an impact point belongs to the method for a plane, comprise: two or more cameras are taken the impact point of in plane and plane both sides, the image that image identification unit photographs from above-mentioned camera, identify the image of impact point, if the position of the same picture point of the corresponding different cameras of impact point is identical, this impact point belongs to this plane, otherwise, this impact point is positioned at the both sides of plane, described same picture point refers to a spatial point and a point being positioned in plane, if their imaging point position is identical, the point in plane is called the same picture point of spatial point, wherein judge the whether identical employing in position of the same picture point of the corresponding different cameras of impact point: fetch bit is put in the plane, size is fixed and known object of reference, object of reference at least comprises not three points on same straight line, according to the corresponding relation of physical location in the position of imaging point and plane, position calculation from the picture of impact point image goes out it with the picture point position with respect to object of reference in the plane, the image calculation of relatively taking from multiple cameras same picture point is out in the plane with respect to the position of object of reference.
2. a mouse apparatus, comprises left button, right button, it is characterized in that:
Comprise two or more cameras, the moving object of working face and working face top is taken;
Image identification unit: identify the image of moving object and the image of object of reference from working face background image;
Judging unit: judge whether moving object contacts with working face, adopt the method for claim 1 to judge, the wherein corresponding impact point of moving object, working face corresponding flat;
Computing unit: if moving object contacts with working face, calculate the speed that moving object contact site moves along working face; Control communication unit: the velocity information that contact site is moved along working face, gesture information and right and left key keystroke information send host computer system to, control moving or carrying out associative operation of cursor on screen.
3. mouse apparatus according to claim 2, is characterized in that: moving object is user's finger.
4. mouse apparatus according to claim 2, is characterized in that: working face is surface of keyboard.
5. mouse apparatus according to claim 4, is characterized in that: surface of keyboard is level and smooth.
6. mouse apparatus according to claim 4, is characterized in that; Refer to that holder is arranged between two row's buttons adjacent on keyboard, refers to that holder has been the fixed support that props up finger effect.
7. mouse apparatus according to claim 2, is characterized in that: right and left key is positioned at and refers to that holder is upper, or is positioned near QWERTY keyboard space bar.
8. a touch-screen, comprises two or more cameras, and the moving object of screen surface and screen one side is taken; Image identification unit: the image that identifies moving object from screen background image; Judging unit: judge whether moving object contacts with screen surface, adopt the method for claim 1 to judge, the wherein corresponding impact point of moving object, screen surface corresponding flat; Computing unit: if moving object contacts with screen surface, calculate moving object with respect to the position of object of reference and the coordinate on screen, or the movement velocity of moving object contact site; Control module: according to moving object contact site bit position or movement velocity, carry out corresponding operation.
9. touch-screen according to claim 8, is characterized in that: taking the edge of screen as object of reference.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010297546.XA CN101963848B (en) | 2009-12-29 | 2010-09-21 | Method for determining if target point belong to plane, mouse and touch screen |
| PCT/CN2010/078055 WO2011079640A1 (en) | 2009-12-29 | 2010-10-25 | Method for determining whether target point belongs to flat plane or not, mouse and touch screen |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910189341A CN101776953A (en) | 2009-12-29 | 2009-12-29 | Optical positioning method and finger mouse integrated with keyboard |
| CN200910189341.7 | 2009-12-29 | ||
| CN201010297546.XA CN101963848B (en) | 2009-12-29 | 2010-09-21 | Method for determining if target point belong to plane, mouse and touch screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101963848A CN101963848A (en) | 2011-02-02 |
| CN101963848B true CN101963848B (en) | 2014-06-18 |
Family
ID=42513431
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910189341A Pending CN101776953A (en) | 2009-12-29 | 2009-12-29 | Optical positioning method and finger mouse integrated with keyboard |
| CN2010102446767A Pending CN101882014A (en) | 2009-12-29 | 2010-07-22 | Method for judging whether target point belongs to plane, mouse and touch screen |
| CN201010297546.XA Expired - Fee Related CN101963848B (en) | 2009-12-29 | 2010-09-21 | Method for determining if target point belong to plane, mouse and touch screen |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910189341A Pending CN101776953A (en) | 2009-12-29 | 2009-12-29 | Optical positioning method and finger mouse integrated with keyboard |
| CN2010102446767A Pending CN101882014A (en) | 2009-12-29 | 2010-07-22 | Method for judging whether target point belongs to plane, mouse and touch screen |
Country Status (2)
| Country | Link |
|---|---|
| CN (3) | CN101776953A (en) |
| WO (1) | WO2011079640A1 (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101776953A (en) * | 2009-12-29 | 2010-07-14 | 胡世曦 | Optical positioning method and finger mouse integrated with keyboard |
| CN102339134A (en) * | 2010-07-27 | 2012-02-01 | 晟铭电子科技股份有限公司 | Keyboard having multipoint touch-control panel function |
| GB201103346D0 (en) * | 2011-02-28 | 2011-04-13 | Dev Ltd | Improvements in or relating to optical navigation devices |
| CN102141847A (en) * | 2011-03-16 | 2011-08-03 | 梁庆生 | Method for simulating mouse input |
| CN102163092B (en) * | 2011-03-25 | 2013-11-20 | 胡世曦 | Finger mouse |
| CN102520799B (en) * | 2011-12-22 | 2015-03-25 | 胡世曦 | Projection keyboard |
| CN102609153A (en) * | 2012-01-29 | 2012-07-25 | 胡世曦 | Device for calculating contact position between object and working plane |
| CN102880315A (en) * | 2012-02-25 | 2013-01-16 | 胡世曦 | Mouse device fused with keyboard |
| CN103886810B (en) * | 2012-12-20 | 2017-09-29 | 联想(北京)有限公司 | A kind of display device |
| CN106803864A (en) * | 2013-01-25 | 2017-06-06 | 陈旭 | Certain graphics context collection identifying device |
| CN104423720B (en) * | 2013-09-02 | 2018-01-05 | 颜涌 | A kind of computer input apparatus and method based on camera |
| CN104049747B (en) * | 2014-01-24 | 2017-02-08 | 胡世曦 | Mouse device for directly controlling cursor with finger |
| KR102382999B1 (en) | 2015-01-08 | 2022-04-05 | 삼성디스플레이 주식회사 | Display device including touch sensor |
| CN106066704A (en) * | 2016-06-04 | 2016-11-02 | 胡世曦 | A kind of mouse using radio-frequency technique |
| CN106020519A (en) * | 2016-07-14 | 2016-10-12 | 胡世曦 | Novel mouse |
| CN107340962B (en) * | 2017-04-13 | 2021-05-14 | 北京安云世纪科技有限公司 | Input method and device based on virtual reality equipment and virtual reality equipment |
| CN108616712B (en) * | 2018-04-18 | 2020-11-10 | 深圳中电数码显示有限公司 | Camera-based interface operation method, device, equipment and storage medium |
| CN108803888A (en) * | 2018-09-12 | 2018-11-13 | 丁翔鹏 | A kind of keyboard |
| CN110941367A (en) * | 2018-09-25 | 2020-03-31 | 福州瑞芯微电子股份有限公司 | Identification method based on double photographing and terminal |
| CN110286780B (en) * | 2019-06-26 | 2022-06-07 | 西南民族大学 | Electromechanical hybrid unattended computer operating device based on machine vision |
| CN114148840A (en) * | 2021-11-12 | 2022-03-08 | 安徽新华学院 | Elevator air key implementation method and system based on 3D sensor |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101013349A (en) * | 2007-02-09 | 2007-08-08 | 山西大学 | Electronic plane display positioning system and positioning method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009148210A1 (en) * | 2008-06-02 | 2009-12-10 | Lg Electronics Inc. | Virtual optical input unit and control method thereof |
| CN101344816B (en) * | 2008-08-15 | 2010-08-11 | 华南理工大学 | Human-machine interaction method and device based on sight tracing and gesture discriminating |
| CN101533322B (en) * | 2009-04-13 | 2012-04-25 | 杭州电子科技大学 | Multi-point touch plate and multi-point touch positioning method |
| CN101776953A (en) * | 2009-12-29 | 2010-07-14 | 胡世曦 | Optical positioning method and finger mouse integrated with keyboard |
-
2009
- 2009-12-29 CN CN200910189341A patent/CN101776953A/en active Pending
-
2010
- 2010-07-22 CN CN2010102446767A patent/CN101882014A/en active Pending
- 2010-09-21 CN CN201010297546.XA patent/CN101963848B/en not_active Expired - Fee Related
- 2010-10-25 WO PCT/CN2010/078055 patent/WO2011079640A1/en active Application Filing
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101013349A (en) * | 2007-02-09 | 2007-08-08 | 山西大学 | Electronic plane display positioning system and positioning method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101882014A (en) | 2010-11-10 |
| CN101776953A (en) | 2010-07-14 |
| CN101963848A (en) | 2011-02-02 |
| WO2011079640A1 (en) | 2011-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101963848B (en) | Method for determining if target point belong to plane, mouse and touch screen | |
| JP7248640B2 (en) | Electronic equipment with complex human interface | |
| CN102144208B (en) | Multi-touch touchscreen incorporating pen tracking | |
| US20080180399A1 (en) | Flexible Multi-touch Screen | |
| CN102422254B (en) | Displays for electronic devices that detect and respond to the size and/or angular orientation of user input objects | |
| US20070242054A1 (en) | Light transmission touch panel and manufacturing method thereof | |
| CN102314301A (en) | Virtual touch sensing system and method | |
| CN102165399A (en) | Multi-touch tochscreen incorporating pen tracking | |
| JPH1139093A (en) | Information processor and pointing device | |
| CN103744542B (en) | Hybrid pointing device | |
| CN102135839B (en) | Terminal and input method thereof | |
| CN103686283A (en) | Smart television remote controller man-machine interaction method | |
| CN101369198A (en) | Flexible multi-touch control point panel | |
| JP2009258946A (en) | Capacitive touch sensor | |
| CN103941919A (en) | Touch event identification mode | |
| CN102236490A (en) | Input device and input method based on multi-finger capacitive touch technology | |
| JP2010160772A (en) | Electronic apparatus with virtual input device | |
| CN102722295A (en) | Touch screen | |
| US20100128005A1 (en) | Touch panel by optics unit sensor | |
| TWM451589U (en) | Optical sensing type input device | |
| CN206674011U (en) | A kind of rear shell has the smart mobile phone of touchpad operation function | |
| CN201383135Y (en) | Multiple touch control interactive device | |
| CN202404565U (en) | Laminating capacitive touch screen | |
| CN102221924A (en) | Display screen and electronic equipment | |
| CN207704418U (en) | A kind of capacitive touch screen structure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140618 Termination date: 20200921 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |