CN101258536A - Multidimensional input device - Google Patents
Multidimensional input device Download PDFInfo
- Publication number
- CN101258536A CN101258536A CNA2006800250392A CN200680025039A CN101258536A CN 101258536 A CN101258536 A CN 101258536A CN A2006800250392 A CNA2006800250392 A CN A2006800250392A CN 200680025039 A CN200680025039 A CN 200680025039A CN 101258536 A CN101258536 A CN 101258536A
- Authority
- CN
- China
- Prior art keywords
- control signal
- input control
- freedom
- sensor
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
A multidimensional input device, such as a computer mouse, is disclosed. In one embodiment, the multidimensional mouse comprises three sensors and a chassis. Each sensor is suitable for finger operation and capable of generating two control signals which represent motion in two degrees of freedom. The three sensors are coupled to the chassis which is suitable for a user to grasp with one hand. Thus, a user can generate six control input signals representing motion in six degrees of freedom with one hand.
Description
Technical field
The present invention relates generally to people/machine interface arrangement, and relate more particularly to object control device (objectcontrolling device), such as operating rod, computer mouse or the like.
Background technology
Three-dimensional (" 3D ") input media is used to high-end 3D computer-aided design (CAD) (" CAD ") and 3D plays up software market.Such 3D input media such as keyboard does not provide " mouse level (mousegrade) ", high-precision two-dimensional (" 2D ") cursor to move, and therefore requires to replenish input peripheral usually.The user will use his right hand to operate the 2D mouse usually, and will use his left hand to utilize the 3D input media in keyboard left side.As a result, require the user to use two hands to carry out the 3D graphic work.
In the past, do several and attempted making the manipulation facility of 3D application.United States Patent (USP) NO.4,811,608 disclose a kind of operating rod of six-freedom degree.Yet this operating rod requires to be used for the standard mouse of conventional 2D cursor control.United States Patent (USP) NO.6,115,028 disclose the input media of the input control with 2D mouse function and four degree of freedom.Yet because the ergonomics problem, this input media is not accepted by the terminal user well.United States Patent (USP) NO.6,844,871 disclose a kind of charge-coupled image sensor (" CCD "), and this charge-coupled image sensor provides the input control of six-freedom degree.Yet this device has operational ergonomics difficulty.
The other method of adding function to standard mouse is that tracking ball is incorporated into (referring to United States Patent (USP) NO.5,298,919,6,184,869 and 5,959,614) in the mouse body.Yet such mouse can not be provided to fly in the virtual 3D environment and pass through (fly-through) mobile desired usually rough or fast speed 3D order control.
Other general input media that uses comprises game mat and operating rod.Yet game mat and operating rod utilize the recreation particular design usually, and the cursor of mouse function is not provided.As a result, game mat and operating rod are not suitable for conventional business software.
The requirement of 3D input media changes significantly, and depends on the content that 3D uses.For example, 3D CAD user requires high precision 3D order control usually, this means the control rate slow (except " watching fast " action to the 3D object) that 3D handles.On the other hand, 3D business software (such as virtual building model or virtual 3D geologic map) requires to pass through or roam based on flight the 3D order of (walk-through) usually.For the application of these kinds, require fast speed order, with fast moving in virtual 3D environment at six-freedom degree.Under the situation of 3D PC recreation, for the quick order of roaming situation requirement, and require high precision/3D control at a slow speed at six-freedom degree, such as deflection or pitching, be used for target shooting (target shooting).
Needed is the manipulation multi dimension device easily that makes 3D application with tradition and effective and efficient manner.In addition, neededly provide traditional 2D input command and at the device of the order of six-freedom degree.And, needed be easily with the system that is connected (interface) effectively with the multi dimension device interface.
The example of aforementioned association area and relative restriction are intended that illustrative, rather than exclusive.Based on to the reading of instructions and the research of accompanying drawing, other restriction of association area will become obvious to those skilled in the art.
Summary of the invention
Following examples and aspect thereof combine with system, tool and method and are described and by graphic extension, these systems, tool and method mean it is exemplary and explanat, not limited field.In various embodiments, reduced or eliminated one or more the problems referred to above, other embodiment points to other improvement simultaneously.
The purpose of this invention is to provide computer input unit, this computer input unit allows multidimensional to be input to computing machine or computerized system.
Another object of the present invention provides computer mouse, and this computer mouse provides 3D input capability at least to computer system.
Another purpose of the present invention provides intuitively and easy-to-use people/machine interface.
Another object of the present invention provides computer input unit, this computer input unit and traditional computer input unit (for example 2D mouse apparatus) compatibility.
In one embodiment, multi-dimensional input device comprises first sensor, second sensor, the 3rd sensor and casing (chassis).This first, second and the 3rd sensor can be suitable for finger manipulation.First sensor can produce first input control signal and second input control signal.First input control signal can be illustrated in the motion of first degree of freedom, and second input control signal can be illustrated in the motion of second degree of freedom.Second sensor can produce the 3rd input control signal and the 4th input control signal.The 3rd input control signal can be illustrated in the motion of Three Degree Of Freedom, and the 4th input control signal can be illustrated in the motion of four-degree-of-freedom.The 3rd sensor can produce the 5th input control signal and the 6th input control signal.The 5th input control signal can be illustrated in the motion of five degree of freedom, and the 6th input control signal can be illustrated in the motion of six degree of freedom.These three sensors can be coupled to casing, and this casing is suitable for the user and grasps with a hand.Therefore, the user can produce six control input signals of the motion that is illustrated in six-freedom degree by enough hands.
In some interchangeable embodiment, casing can have the bottom surface that is suitable for sliding in the plane.Sensor can be positioned on the bottom surface of casing.The sensor that is positioned at bottom of shell can produce the 7th input control signal and the 8th input control signal.The 7th input control signal can be represented seven freedom, and the 8th input control signal can be represented eight degrees of freedom.In other embodiments, casing can have the wheel that pivotally is coupled to the casing end face.This is taken turns and can be suitable for finger manipulation, and can produce the 9th input control signal.The 9th input control signal can be represented nine-degree of freedom.
In certain embodiments, first, second, third, fourth, the 5th and six degree of freedom can represent fast/rough Three dimensional steerable, and the 7th, the 8th and nine-degree of freedom can represent traditional two-dimensional operation.In interchangeable embodiment, casing can be a mouse body, and can comprise two mouse buttons, thereby utilizes the manipulation facility that a device is used 3D and traditional 2D uses.
And in another embodiment, first, second and the 3rd sensor can be followed three-dimensional intuitively command mapping rule.For example, rotate in mode from left to right along axle in order to make object, the user can touch at the rear portion of the sensor in casing left side, and touches the forward direction part (forwardportion) of the sensor on the opposite side.
In other embodiments, degree of freedom can be by the mobile expression in the X-Y-Z plane.Along moving of axle can be translation, and moving of threaded shaft can be rotation.In one embodiment, first degree of freedom can be by the mobile expression along X-axis.Second degree of freedom can be represented by the angular motion around X-axis.Three Degree Of Freedom can be by the mobile expression along Y-axis.Four-degree-of-freedom can be by the mobile expression along the Z axle.Five degree of freedom can be represented by the angular motion around Y-axis, and six degree of freedom can be by representing around the angular motion of Z axle.
In some interchangeable embodiment, seven freedom and eight degrees of freedom can be by the mobile expressions in two-dimentional X-Y plane.In addition, nine-degree of freedom can be by the mobile expression along the Z axle.And in a further embodiment, the user can create the configuration that the regulation degree of freedom is represented.In other embodiments, degree of freedom can depend on various hardware and/or software factor and change.
Interchangeable embodiment in addition changes the position of the sensor on the casing.For example, in one embodiment, the first sensor and second sensor can be positioned on the opposite side of casing, and the 3rd sensor is positioned at the top of casing.In another embodiment, all the sensors can be positioned at the top of casing.In interchangeable embodiment, two same side that can be positioned at casing in these sensors, and the 3rd sensor is positioned at the top of casing.Sensor also can center on or be arranged in the hole of casing each other.
In other embodiments, sensor can change.For example, sensor can be simulation, numeral, touch pad or angle wheel (tilt wheel).And two or more sensors can be combined and form compound transducer.In other embodiments, casing can be integrated in keyboard, laptop computer or the operating rod.In another embodiment, casing can be a mouse body.
Another embodiment comprises operating rod.Operating rod can comprise tracking ball, operating rod handle (stem) and base.Tracking ball can produce the 7th input control signal and the 8th input control, and the 7th input control signal and the 8th input control can be illustrated in the motion of seven freedom and eight degrees of freedom.The operating rod handle can have top and bottom, and can produce the 9th input control signal and the tenth input control signal.The 9th input control signal can be illustrated in the motion of nine-degree of freedom, and the tenth control signal can be illustrated in the motion of the tenth degree of freedom.The bottom of operating rod handle and tracking ball can be coupled to the top of base.Casing can be coupled to the top of operating rod handle.In a further embodiment, operating rod can make the Three dimensional steerable facility of robot.In addition, operating rod can comprise video camera or the clamper that is coupled to the operating rod handle.
In another embodiment, multi dimension device can further comprise hand-held controller.This hand-held controller can comprise tracking ball, right mouse button, left mouse button, wheel, a plurality of programmable digital button and be used for the lcd screen of display device state.This casing can be coupled to hand-held controller.
In other embodiments, multi dimension device can further comprise USB connector, is used for providing input control signal to computing machine.In a further embodiment, this device can comprise user-programmable buttons and lcd screen.
Interchangeable embodiment is interface connecting system (interfacing system).This interface connecting system can comprise multi dimension device and firmware program.This multi dimension device can have a plurality of sensors that comprise first group and second group.First group of sensor can produce first group of input control signal, and second group of signal can produce second group of input control signal.Firmware program can be embedded in the multi dimension device, and can produce output.This output can be simulated first logical unit and second logical unit.This first logical unit can be represented first group of input control signal, and this second logical unit can be represented second group of input control signal.Reception from the computing machine of the output of multi dimension device can as exist two independently logical unit operate.
In a further embodiment, first logical unit of interface connecting system can be used to handle two dimensional application, and second logical unit can be used to handle three-dimensional applications.And, in interchangeable embodiment, firmware program can further comprise two-dimentional input control signal from module and three-dimensional input control signal from module.In interchangeable embodiment, the user class interface software module on the host PC can allow the user to use second logical unit alternatively, is used for handling the two 3D application program of Windows XP and Windows Vista.In other embodiments, multi dimension device can comprise the USB connector that is used for being coupled to separably USB port on computers.
In other embodiments, multi dimension device can further comprise the 3rd group of sensor.The 3rd group of sensor can produce the 3rd group of input control signal.The 3rd logical unit can be represented the 3rd group of input control signal.The 3rd logical unit can be by output expression, therefore allows independently logical unit of three of COMPUTER DETECTION.
Another exemplary embodiment is the method that is used for multidimensional control.This method comprises provides first sensor, second sensor, the 3rd sensor and casing.This first sensor is suitable for finger manipulation and can produces first and second input control signals.This first input control signal can be illustrated in the motion of first degree of freedom, and second input control signal can be illustrated in the motion of second degree of freedom.This second sensor is suitable for finger manipulation, and can produce third and fourth input control signal.The 3rd input control signal can be illustrated in the motion of Three Degree Of Freedom, and the 4th input control signal can be illustrated in the motion of four-degree-of-freedom.The 3rd sensor is suitable for finger manipulation, and can produce the 5th and the 6th input control signal.The 5th input control signal can be represented five degree of freedom, and the 6th input control signal can be represented six degree of freedom.This casing can be suitable for the user and grasp with a hand, and can be coupled to first, second and the 3rd sensor.Then, in the position that allows the user to produce six input control signals of the motion that is illustrated in six-freedom degree with a hand, this first, second be coupled to casing with the 3rd sensor.
Except aforesaid illustrative purpose of the present invention, aspect and the embodiment, by with reference to the accompanying drawings and by research explanation subsequently, it is obvious that other purpose, aspect and embodiment will become.
Description of drawings
Exemplary embodiment is illustrated in the reference pattern of accompanying drawing.The embodiment disclosed herein and figure intention are considered to illustrative and not restrictive.
Fig. 1-3 shows the multidimensional mouse according to exemplary embodiment, and this multidimensional mouse provides traditional three degree of freedom (x, the y mouse moves and take turns rotation), and has independently six-freedom degree command characteristics;
It is how mapped that Fig. 4 shows the 3D order according to exemplary embodiment;
Fig. 5-7 shows sensing data according to exemplary embodiment and how to be mapped to 3D order intuitively;
Fig. 8-11 shows (mouse among Fig. 1) interchangeable 3D command mapping according to exemplary embodiment, and these 3D command mapping are to use such as two gestures that push away and reverse and at the 3D command mapping of Y/Z translation and deflection/scroll command;
Figure 12-19 has described various interchangeable sensing station and the configuration on the mouse body according to exemplary embodiment;
Figure 20 A-20E shows the various sensors that two degree of freedom orders can be provided according to exemplary embodiment;
Figure 21 A-21E shows according to exemplary embodiment and includes two independently sensor elements of various four degree of freedom of two degree of freedom sensor elements;
Figure 22 A-22B according to exemplary embodiment show by two independently two degree of freedom sensors constitute another the group four degree of freedom sensor elements;
Figure 23 A-23F shows by two two four other degree of freedom sensor elements that the degree of freedom sensor constitutes independently according to exemplary embodiment;
Figure 24 shows the mouse of the sensor element with various combinations according to exemplary embodiment;
Figure 25 A shows conventional keyboard and the PC on knee that has equipped other multi-dimensional input device according to exemplary embodiment;
Figure 25 B shows the 3D command mapping of three sensors (being installed in three little touch pads of right-hand side corner) according to exemplary embodiment;
Figure 26 shows the interchangeable multi-dimensional input device of PC on knee according to exemplary embodiment;
Figure 27 shows another interchangeable implementation of the multi-dimensional input device that utilizes single touch pad according to exemplary embodiment;
Figure 28 A-28K shows the operating rod of various ten degree of freedom according to exemplary embodiment;
Figure 29 shows the hand-held controller of nine degree of freedom according to exemplary embodiment;
Figure 30 A-30B shows the controller of nine degree of freedom how handling Figure 29 according to exemplary embodiment;
Figure 31 A-31B shows another embodiment of the hand-held controller of nine degree of freedom according to exemplary embodiment;
Figure 32-33 shows according to exemplary embodiment and is used for the system that interface connects multi dimension device and host PC;
Figure 34 shows the interface software that the utilizes a plurality of degree of freedom input commands method that provides according to exemplary embodiment;
Figure 35 shows nine degree of freedom mouses with programmable button and little lcd screen according to exemplary embodiment; And
Figure 36-37 shows the interface method of the input media that comprises several disparate modules according to exemplary embodiment.
Embodiment
The present invention has instructed described here or has been conspicuous various device, method and other theme in accordance with the teachings of the present invention for those skilled in the art.The present invention has further instructed various embodiment, aspect etc., and they self right has nothing in common with each other.Be suitable for the background that those skilled in the art of the present invention can have computer science, computer engineering, electrical engineering, mechanical engineering etc.Disclosed optimal mode is an example of the present invention disclosed herein, and is not intended to limit the scope of the invention.
As discussed above such, a kind of multi-dimensional input device is disclosed.In one embodiment, this device comprises three sensors, and each sensor in these sensors provides the input control signal of the motion that is illustrated in two degree of freedom.In other embodiments, the casing of coupling sensor further comprises another sensor and wheel, thereby provides input control signal for other three degree of freedom.Casing can be shaped to mouse, and traditional 2D or accurate 3D function is provided, and quick and/or rough 3D function is provided.In addition, disclose and be used for the system that is connected with the multi dimension device interface, wherein from two logical units of output by COMPUTER DETECTION.
Fig. 1-3 shows multi dimension device 100.Fig. 1 has described the top left view of this multi dimension device, and Fig. 2 has described the vertical view of this multi dimension device, and Fig. 3 has described the right side view of this multi dimension device.As illustrated, this multidimensional mouse 100 comprises the casing 170 of left sensor 110, right sensor 120, top sensor 130, left mouse button 1 60, right mouse button 1 40, wheel 150 and mouse body shape.Multidimensional mouse 100 among the embodiment shown in Fig. 1-3 can provide traditional three degree of freedom and other six-freedom degree.Traditional three degree of freedom is that the mouse at the X-Y plane (not shown) from the sensor (not shown) on the bottom of mouse body 170 moves and traditional wheel rotation 150.In addition, multidimensional mouse 100 is provided for the six-freedom degree that is independent of the X-Y plane (not shown) that mouse moves.As illustrated, top sensor is aligned on the X-Z plane in the reference frame shown in Fig. 1-3 180.Be aligned on right sensor 120 and the Y-Z coordinate of left sensor 110 in reference frame 180.
In operation, the bottom sensor (not shown) can produce two input control signals of the motion (just traditional mouse moves) that is illustrated in two degree of freedom.In addition, wheel can produce the input control signal of the motion (just traditional wheel moves) that is illustrated in another degree of freedom.In left side sensor 110, right sensor 120 and the top sensor 130 each can both produce two input control signals of the motion (moving in the X-Y-Z plane 180 just) that is illustrated in two degree of freedom.In addition, each sensor can provide X and the Y position data on the local coordinate.Be used for the interface software of host PC by exploitation, the local X/Y position data of sensor can be converted into the 3D order data, to be used in combination with 3D graphics application program on the host PC.
Independently the six-freedom degree feature also needn't provide " change in location " control command (zeroth order control command).Yet normally the speed command of single order order is suitable at the quick 3D order of moving and/or rotating.Therefore, by utilizing mouse to move and/or utilize the wheel rotation of mouse button, the user can use the multidimensional mouse shown in Fig. 1-3 to produce to be used for accurate (good) order that 3D handles, such as being used for the CAD design effort.Equally, the user can use three sensors that are used for independently six-freedom degree order to produce (roughly) 3D order fast, passes through such as the flight in the 3D graphics environment.
The technician of area of computer graphics will be familiar with and understand, and the variation of position control is commonly called " zeroth order control ", and rate controlled or speed control are commonly called " single order control ".By position control, mean by cursor position and come the mapping device displacement.Under the situation of mouse, the relative variation of the displacement of mouse body (Δ M) can be relatively move (the Δ L) of moving cursor.Just why such control is called as zeroth order control for this.When power or displacement were mapped to the translational speed of cursor, such control was called as rate controlled or single order control.
Fig. 4-7 shows has the multi dimension device 200 that exemplary six-freedom degree is represented.In an illustrated embodiment, multi dimension device 200 comprises left sensor 210, right sensor 220, top sensor 230 and casing 240.Sensor 210,220 and 230 is coupled to casing 240, and this casing 240 is suitable for the user and grasps with a hand.By development interface software, the X/Y local location data of sensor can be mapped to the 3D order of the 3D graphical application software that is used for using on host PC.The exemplary expression of six-freedom degree can be mapping directly perceived.Mapping directly perceived comprises that the sensor signal that will be used for six-freedom degree is mapped to the 3D order, and the direction of the mobile/rotation that makes that the user points is identical with the direction that moves/rotate with the object of figure control.Yet in interchangeable embodiment, the user can rearrange these 3D command mapping Cheng Qiru by the determined preferred mapping of the interface software on the host PC.
Fig. 5-7 shows sensing data according to exemplary embodiment and how to be mapped to 3D order intuitively.In Fig. 4 and Fig. 5, when the user touched the right point (X+ direction) of top sensor 230, the input control signal of Chan Shenging can be used to the X+ translation order of 3D graphics environment thus.When the user touched the left point (X-direction) of top sensor 230, the input control signal of Chan Shenging can be used to the X-translation order of 3D graphics environment thus.When the user touched the forward face point (Z+ direction) of top sensor 230, the input control signal of Chan Shenging can be used to positive pitching (rotating around the X-axis) order of 3D graphics environment thus.When the user touch top sensor 230 back when point (Z-direction), the input control signal of Chan Shenging can be used to negative pitching (rotating around the X-axis) order of 3D graphics environment thus.
In Fig. 4 and Fig. 6, when the user touches the upper point (Y+ direction) of left sensor 210, can be used to just rolling (around the rotation of the Z axle) order of 3D graphics environment by the input control signal of this some generation.When the user touches the lower point (Y-direction) of left sensor 210, can be used to the negative scroll command of 3D graphics environment by the input control signal of this some generation.When the user touches the forward face point (Z+ direction) of left sensor 210, can be used to positive deflection (rotating) order of 3D graphics environment by the input control signal of this some generation around Y-axis.When the user touch left sensor 210 back when point (Z-direction), the negative bias that the input control signal that is produced by this point can be used to the 3D graphics environment changes (rotate around Y-axis) orders.
In Fig. 4 and Fig. 7, when the user touches the upper point (Y+ direction) of right sensor 220, can be used to the positive Y translation order of 3D graphics environment by the input control signal of this some generation.When the user touches the lower point (Y-direction) of right sensor 220, can be used to the negative Y translation order of 3D graphics environment by the input control signal of this some generation.When the user touches the forward face point (Z+ direction) of right sensor 220, can be used to the positive Z translation order of 3D graphics environment by the input control signal of this some generation.When the user touch right sensor 220 back when point (Z-direction), the signal that is produced by this point can be used to the negative Z translation order of 3D graphics environment.
Fig. 8-11 shows has the multi dimension device 300 that another exemplary six-freedom degree is represented.In an illustrated embodiment, multi dimension device 300 comprises left sensor 310, right sensor 320, top sensor 330 and casing 340.Sensor 310,320 and 330 is coupled to and is suitable for the casing 340 that the user grasps with a hand.In the embodiment shown in Fig. 8-11, show the 3D command mapping at Y/Z translation and deflection/scroll command of use such as two gestures that push away and reverse.
In Fig. 8, the user touches the bottom of right sensor 320 and the top of left sensor 310, is similar to around the Z axle and reverses object clockwise.These paired touch points can be used to produce positive scroll command.This command mapping is very directly perceived, because the sense of rotation of the object in the direction of reversing posture and the 3D environment is identical.
In Fig. 9, the user touches the back forward direction part to part and left sensor 310 of right sensor 320, is similar to around Y-axis and reverses object clockwise.These paired touch points can be used to produce positive deflection command.
In Figure 10 B, the user touches the back to part of right sensor 320 and left sensor 330, and perhaps as shown in Figure 10 A, the user touches the forward direction part of right sensor 320 and left sensor 330, is similar to respect to the Z axle and draws or push away object.These paired touch points can be used to produce Z translation order.In the embodiment shown in Figure 10 C, the user touches the top of right sensor 320 and left sensor 330, and perhaps as shown in Figure 10 D, the user touches the bottom of right sensor 320 and left sensor 330, is similar to respect to Y-axis and draws or push away object.These paired touch points can be used to produce Y translation order.
In Figure 11 A, the user touches the back forward direction part to part and left sensor of right sensor 320, perhaps as shown in Figure 11 B, the user touches the back to part of the forward direction part of right sensor 320 and left sensor 310, with produce around Y-axis just or the negative rotation commentaries on classics.In the embodiment shown in Figure 11 D, the user touches the top of right sensor 320 and the bottom of left sensor 310, perhaps as shown in Figure 11 C, the user touches the bottom of right sensor 320 and the top of left sensor 310, with produce around the Z axle just or negative rotation change.
Based on the design philosophy of the multi dimension device shown in Figure 12 1000,, can revise mouse shape and sensor alignment by other exemplary and nonrestrictive example.Figure 12-19 has described various interchangeable sensing stations and configuration according to exemplary embodiment.In the embodiment shown in Figure 12-14, the casing 1070 that is formed mouse body comprises left sensor 1010, right sensor 1030, top sensor 1020, left mouse button 1 060, right mouse button 1 040 and takes turns 1050.Top sensor 1020 is installed in the cavity of mouse end face.Figure 12 shows the top left view of this mouse, and Figure 13 shows vertical view, and Figure 14 shows side view.Utilize interface software, the user can be worked to the identical 3D command mapping shown in Fig. 5-11.
Figure 15 shows the device 2000 with two sensors that are installed in the left side.In an illustrated embodiment, the casing 2070 that is formed mouse body comprises first left sensor 2010, the second left sensor 2020, top sensor 2030, left mouse button 2 040, right mouse button 2 050 and takes turns 2060.The second left sensor 2020 can be used to Y/Z translation order, and the first left sensor 2010 can be used to deflection/scroll command generation.Top sensor 2030 can be used to the order generation of X translation and be used for pitching command.
Figure 16 shows the device 2100 with compound transducer.In an illustrated embodiment, the casing 2170 that is formed mouse body comprises first left sensor 2110, the second left sensor 2120, top sensor 2160, left mouse button 2 130, right mouse button 2 150 and takes turns 2140.The first left sensor 2110 and the second left sensor 2120 are combined and form compound transducer.The first left sensor 2110 that is installed on the perimeter of compound transducer can be used to Y/Z translation order, can be used to deflection/scroll command and generates and be installed in the second left sensor 2120 on the interior zone of compound transducer.
Figure 17-19 shows the interchangeable embodiment that has three sensors at the top of casing.In Figure 17, show device 2200 with three sensors that are elevated.As shown in the figure, the casing 2210 that is formed mouse body comprises the left sensor 2220 that is elevated, the right sensor 2230 that is elevated, the top sensor 2240 that is elevated, left mouse button 2 250, right mouse button 2 260 and takes turns 2270.
In Figure 18 A, show device 2300 with two sensors that are elevated.As shown in the figure, the casing 2310 that is formed mouse body comprises the left sensor 2320 that is elevated, the right sensor 2330 that is elevated, top sensor 2340, left mouse button 2 350, right mouse button 2 360 and takes turns 2370.Figure 18 B shows the vertical view of the device 2300 shown in Figure 18 A.
In Figure 19 A, show the device 2400 of three sensors that are elevated with T structure.As shown in the figure, the casing 2410 that is formed mouse body comprises the left sensor 2420 that is elevated, the right sensor 2430 that is elevated, top sensor 2440, left mouse button 2 450, right mouse button 2 460 and takes turns 2470.Figure 19 B shows the vertical view of the device 2400 shown in Figure 19 A.
Above shown in the embodiment purpose of property presented for purpose of illustration only, and should not be interpreted as restriction, because other embodiment will be conspicuous for those skilled in the art.For example, wherein, only raise a button, mouse button can be removed, and wheel can be removed, and the button that is elevated can form compound transducer, and the sensor that is elevated can be outstanding from the side of casing.
Various sensors can be used in combination with various other embodiment.According to exemplary embodiment, Figure 20 A-20E shows the various sensors of the input control signal that two degree of freedom of expression can be provided.Sensor 3000 has been described analog sensor and printed circuit board (PCB) (" PCB ") thereof, to provide the X/Y in the local coordinate position by the circular surface that pushes away sensor lightly on PCB.By finger touch, the handle of sensor will tilt, and depend on the degree that the sensor handle tilts and produce the X/Y signal, therefore produce the input control signal of the motion that is illustrated in two degree of freedom.PCB on the sensor will handle original simulating signal, and this analog signal conversion be become can be used to the digital signal of the microprocessor of computing machine.
For example, depend on its handle angle, the analog sensor of 8 bit resolution types will produce the data point of a series of 0 to 255 X and Y value.As long as the user is just at the touch simulation sensor, the just continuous real estate life of this sensor is corresponding to specific X, the Y data of the direction of finger strength and power.X, the value of Y data in local coordinate can be used as the speed command in the 3D graphical application.Analog sensor can get from a plurality of sellers on market, such as the DomePoint from Japanese fujitsu element company limited (Fujitsu Component Co.Ltd.)
TMSensor.
Sensor 3100 has been described 4 way word buttons and relevant PCB thereof.This digital sensor provides four independently digital switch signals (north, east, south, west), and these signals can be used as the input control signal of the motion that is illustrated in two degree of freedom.Sensor 3200 has been described 8 way word buttons and relevant PCB thereof.Digital sensor 3200 provides eight independently digital switch signals, and these signals can be used as the input control signal of the motion that is illustrated in two degree of freedom.
The digital signal of these digital buttons also can be used as speed command.For example, if the user pushes the north point of this digital button, produce (1,0,0,0) signal so.If the user pushes the east point of digital button, produce (0,1,0,0) signal so.The value of numerical data in local coordinate can be used as speed command, such as the constant speed order of Y+ translation in the 3D graphical application and X+ translation respectively.
The sensor 3300 that is called as touch pad provides X/Y finger position in the local coordinate of sensor surface.Touchpad sensor can obtain on market, as the Synaptics touch pad of the Synaptics company of California, USA (California) San Jose (San Jose).This touch pad is used as interchangeable mouse equivalence input media at first, and the signal of the signal of " finger position variation " as the control of 2D cursor is provided.Touchpad sensor 3300 can be used to produce the input control signal of two degree of freedom of expression.Yet, the touch pad signal simply is used for the 3D graphical application will produce speed command, because when the user stops his/her mobile on touchpad surface of finger, this touch pad signal will be zero.
For the touch pad signal being used as the speed command of 3D graphical application, interface software can convert speed command to " finger position variation " alternatively, and is as follows.Following example pseudo-computer program can be used as the basis that the touch pad conversion of signals is become to be used for the speed command of 3D graphical application.
// // // false code // // // // // //
End-less?loop
[START
Get?current?touchpad?data(data?of?finger?position?change?DelX(i)，scancycle＝ith)；
If?the?data?of?position?change?is?not?zero?value，
// this means that the user is moving his finger.//
Then，make?velocity?command?Vx(i)＝A*DelX(i)；
// wherein, A is constant or gain.//
If?position?change?is?zero?value?and?the?status?of?finger?touch?is?YES，
// this means that the user stops to move still still touch.//
Then，use?velocity?command?Vx(i-1)as?current?velocity；
Vx(i)＝Vx(i-1)；
The speed data of last scan period of // use.//
If?position?change?is?zero?value?and?the?status?of?finger?touch?is?NO，
// this means that the user discharges his finger on touch pad.//
Then?use?velocity?command＝0as?current?velocity；
Vx(i)＝0；
Return?to?START?and?process?for?next?scan?cycle；
]
End?ofloop
// // // // // // // // // // // // // ///end of false code // // // // // // // // // // // ///
The false code that use is listed above for example can be used to the speed command generation that 3D handles based on the sensor that touches.When the user only moves their finger a little, though user's finger move stop after, speed command also can be produced continuously.
Figure 20 E shows the angle wheel parts 3350 of the input pickup that also can be implemented as two degree of freedom according to exemplary embodiment.As the result who wheel is pushed to or pushed or changes to the left or to the right angle wheel, angle wheel 3350 can provide the position of rotation of angle wheel in the local coordinate of wheel to change, take turns the digital signal and the digital ON/OFF signal of the downward/state that makes progress alternatively, and all these signals can be used to produce the input control signal of the motion that is illustrated at least two degree of freedom.The angle wheel of this kind can be on market from the State of Washington Microsoft of (Washington) Redmond (Redmond) obtain.Except " position of rotation variation " signal as the initialize signal of wheel component, angle wheel can be modified the digital signal that one degree of freedom is provided.The signal application of this angle wheel will not produced the speed command of two degree of freedom to the 3D graphical application.This is because when the user stopped his/her mobile on wheel surface of finger, rotating position signal was zero.(digital signal that obtains by angle wheel can be used as the speed command of one degree of freedom.)
For with the angle wheel signal as speed command at two degree of freedom of 3D graphical application, preferably need interface software 3360 that " position of rotation variation " is converted to speed command.It is the basis that is used for the speed command of 3D graphical application that following exemplary pseudo-code can be used as the angle wheel conversion of signals:
// // // be used for the false code of angle wheel // // // // // //
End-less?loop
[START
Get?current?wheel?rotation?data?and?status?of?wheel?center?button(wheelDOWN/UP)
(data?of?rotational?position?change?DelRotation(i)，scan?cycle＝ith)；
If?status?of?wheel?is?DOWN，
Then
{
If?the?data?of?rotational?position?change?DelRotation(i)is?not?zero?value
at?previous?scan?cycle，
// this means that the user was just in time moving his finger before downward push boat.
Then，make?velocity?command?Vw(i)＝A*DelRotation(i)；
// wherein A is constant or gain.
If?rotational?position?change?is?zero?value?at?previous?scan?cycle，
// this means that the user does not have swiveling wheel.
Then，use?velocity?command?Vw(i)＝0；
}
Return?to?START?and?process?for?next?scan?cycle；
]
End?of?loop
// // // // // // // // // // // // // ///end of false code // // // // // // // // // // // ///
The algorithm that use is listed above, by non-limitative example, the speed command that angle wheel can be used to two degree of freedom of 3D manipulation generates.
Figure 21 A-21E shows according to exemplary embodiment and includes two independently various four degree of freedom sensor elements of two degree of freedom sensor elements.The sensor 3400 that is made up comprises analog sensor 3000 and the touchpad sensor 3300 as shown in Figure 20 D as shown in Figure 20 A.The sensor 3400 that is made up provides two independently local X/Y signals corresponding to the position of user's finger touch, and this part X/Y signal indication is in the motion of four degree of freedom.The sensor 3500 that is made up comprises 4 way word buttons 3100 and the touchpad sensor 3300 as shown in Figure 20 D as shown in Figure 20 B.The sensor 3600 that is made up comprises analog sensor 3000 as shown in Figure 20 A and 4 way word buttons 3100 as shown in Figure 20 B.The sensor 3700 and 3800 that is made up comprises two independently touch pads as shown in Figure 20 D.
Figure 22 A-22B according to exemplary embodiment show by two independently two degree of freedom sensors constitute another the group four degree of freedom sensor element.The sensor 3900 that is made up comprises two touch pads and provides corresponding to two of the position of user's finger touch X/Y position signallings independently that these X/Y position signallings are illustrated in the motion of four degree of freedom.The sensor 4000 that is made up comprises two 4 way word buttons.For the 3D order (for example: deflection and rolling) based on two gestures, such as the posture of finishing by the reverse direction that touches two sensors of reversing, the sensor element of these combinations is easily.
Figure 23 A-23F shows by two two four other degree of freedom sensor elements that the degree of freedom sensor constitutes independently according to exemplary embodiment.The sensor 4100 and 4400 that is made up comprises touch pad and analog sensor, and provides corresponding to two of the position of user's finger touch X/Y position signallings independently, and these X/Y position signallings are illustrated in the motion of four degree of freedom.
The sensor 4200 and 4500 that is made up comprises two touch pads, and these touch pads provide corresponding to two of the position of user's finger touch X/Y position signallings independently, and these X/Y position signallings are illustrated in the motion of four degree of freedom.The sensor 4300 and 4600 that is made up comprises 4 way word button and analog sensors, and provides corresponding to two of the position of user's finger touch X/Y position signallings independently, and these X/Y position signallings are illustrated in the motion of four degree of freedom.
Figure 24 shows the mouse of the various combinations with sensor element according to exemplary embodiment.In this specific embodiment, analog sensor 4710 in the left side can be used to roll and deflection command, the touchpad sensor 4720 that is installed on the perimeter of analog sensor 4710 can be used to Y/Z translation order, and the touch pad on the end face of mouse body 4730 can be used to pitching and X translation order.
Figure 25 A shows conventional keyboard and the PC on knee with integrated multi dimension device according to exemplary embodiment.Keyboard 5000 as shown in Figure 25 A-1 has be coupled to casing 5010 three independently analog sensors.Casing 5010 is integrated in the keyboard 5000.Interchangeable keyboard 5100 as shown in Figure 25 A-2 has be coupled to casing 5110 three independently touchpad sensors.Casing 5110 is integrated in the keyboard 5100.At the kneetop computer 5200 that has the integrated casing 5210 that has analog sensor shown in Figure 25 A-3.At another kneetop computer 5300 that has the integrated casing 5310 that has touchpad sensor shown in Figure 25 A-4.Sensor can produce expression respectively along the input control signal that moves on X-Y plane, Y-Z plane and X-Z plane.Embodiment shown in Figure 25 A can be by different sensors or the sensor element that is made up shown in Figure 20-23 and easily is modified.Figure 25 B shows the 3D command mapping of three sensors (being installed in three little touch pads of right-hand side corner) according to exemplary embodiment.
Figure 26 shows the interchangeable multi-dimensional input device 6000 that is used for PC on knee according to exemplary embodiment.In Figure 26, casing 6010 is integrated in the laptop computer.Casing 6010 comprises the rectangular touchpad 6020 that is installed in PC on knee right side, to produce Y-axis and Z axle translation order.Casing 6010 also comprises two independently (but be combined in a position) touchpad sensors 6040,6050 (interior zone and perimeter), and these two touchpad sensors are installed on the end face of right turn angle of computer body.Touchpad sensor 6050 on the interior zone can be used to produce X-axis translation and pitching command.The perimeter of touchpad sensor 6040 further is divided into two sub regions (forward direction subregion and back are to subregion) on function.Signal from the forward direction subregion can be used to initiate the scroll command generation, and can be used to the deflection command generation from the back to the signal of subregion.Utilize single touch pad, by dividing the zone of touchpad surface on function, and the position data that depends on finger touch distributes different 3D orders, can realize on the end face two independently touch pads.Yet the user can not produce two kinds of 3D order simultaneously, such as scroll command and the X translation order on being positioned at the touch pad at top.This is because current available touch pad can not be distinguished two different touch points on the single touch pad parts.
Figure 27 shows another other interchangeable implementation of the multi-dimensional input device 6100 that utilizes single touch pad according to exemplary embodiment.In this case, the perimeter is divided into four zones 6110,6120,6130,6140, and the result exists altogether, and five different zones (interior zone 6150 and four perimeters 6110,6120,6130,6140) are used for producing the 3D order.As shown in Figure 27, because the elimination of the touch pad on the right side, aspect the Y-axis translation, " rule directly perceived " that the 3D command mapping has been mentioned before having violated.In other words, the Y-axis command direction is identical with Z axle command direction.Therefore, require training to get into the way of this interchangeable layout.
Figure 28 A-28K shows the operating rod of various ten degree of freedom according to exemplary embodiment.Figure 28 A-28B has described based on the design philosophy at the operating rod of ten degree of freedom of the application of the design philosophy described in the figure of a lot of fronts.Operating rod 6200 among Figure 28 A, 28B and the 28C comprises tracking ball 6210, left mouse button 6260, right mouse button 6220, operating rod handle 6230, base 6250 and has the casing 6240 of three standalone sensors.The bottom of operating rod handle 6230 is coupled to base 6250, and casing 6240 is coupled to the top of operating rod handle 6230.As shown in the figure, the sensor among Figure 28 A and the 28B is an analog sensor, and the sensor among Figure 28 C is a touchpad sensor.These sensors can be followed " mapping ruler directly perceived ".The 3D that operating rod shown in Figure 28 A, 28B and the 28C can be applied to robot potentially handles.
The 3D that Figure 28 D-28K shows automated guided vehicle (" AGV ") handles.Figure 28 E shows the remote control 6310 of the AGV 6300 that describes among Figure 28 D.AGV 6300 has ccd video camera 6320 and the clamper 6330 that is installed on the removable handle.By utilizing command signal, long-range 6310 can drive AGV 6300 on industry ground slab.By forward with to the pusher operating rod, the user of the operating rod 6310 of ten degree of freedom can produce the order that forward/backward drives AGV 6300.Pushing away operating rod by direction or left to the right, the user also can produce and turn to the right side/left side forward or turn round to the right/order on a left side.
Figure 28 F-28K shows the implementation that Long-distance Control is checked the rolling control of camera view and robot gripper 6400.Remote control comprises the casing 6400 with three touchpad sensors.Touchpad sensor moves corresponding to the parts 6430 of AGV.By drag finger on touch pad 6410, the user can produce X, Y, Z translation, pitching and deflection, is used to handle the ccd video camera 6440 that is installed on the handle.By drag finger on top touch pad 6420, the user can produce the scroll command of the clamper that is used for AGV 6450.
Figure 29 shows the hand-held controller of nine degree of freedom according to exemplary embodiment.The little lcd screen 5070 that controller 5000 comprises tracking ball 5010, left mouse button 5020, right mouse button 5030, wheel 5040, have the casing 5050 of three sensors, ten programmable digital buttons (two buttons are positioned at the left side, and eight buttons are positioned at the right side) 5060 and be used for the display device state.
Figure 30 A-30B shows nine degree of freedom controller 5000 how handling Figure 29 according to exemplary embodiment.Figure 30 A has described the 3D mapping of controller.This 3D command mapping thought is single finger manipulation and based on the composite set of the operation of two gestures.The user reverses posture (two fingers) with use and comes to produce deflection and pitching on front sensor and back sensor.The user also draws use posture (two fingers) to come to produce X and Y translation order on front sensor and back sensor.For the Z translation, the user drags finger and drag finger to the right/left on top sensor in forward/backward on the top sensor and produces scroll command.Figure 30 B shows how to use the controller that is used for 2D order control, and all conventional cursor of clicking with mouse button in this way of this 2D order control move.
Figure 31 A and Figure 31 B show another embodiment of the hand-held controller 7000 of nine degree of freedom according to exemplary embodiment.Hand-held controller 7000 comprises tracking ball 7010, left mouse button 7020, right mouse button 7030, wheel 7040, a plurality of programmable button 7050, lcd screen 7060 and has the integrated casing 7070 of three sensors.The 3D command mapping that is used for this controller is identical with the controller shown in Figure 30 B.
Software can be used to connect the signal from the multi-dimensional input device to the host PC alternatively, so that be connected 3D command mapping directly perceived between the original signal that realizes input media in the 3D graphics application program on the host PC and the final 3D steering command by USB.
Windows XP operating system provides Embedded USB core apparatus driver for the input media based on USB-HID (human-computer interface device).As a result, do not need to develop unique device driver.On the contrary, Embedded USB core apparatus driver can be used as the first step of data acquisition.After the Embedded USB core driver of Microsoft is caught original input data, utilize window application interface (" API ") function package (function package), the user class interface software can be developed and catch original input data, these function package can be write by enough common computer language, such as writing with the C/C++ language.
Use interface structure based on a plurality of logical units at firmware and host PC support software, new input function can be developed on the traditional 2D input media such as traditional USB 2D mouse, and need not to revise existing 2D input function.Logical unit is a kind of on input media " virtual bench ", and the logical unit of any number can be limited on the single assembly.That is to say that a plurality of virtual benchs can be implemented on single input media.
Figure 32 shows according to exemplary embodiment and is used for the system 8000 that interface connects multi dimension device and host PC.In Figure 32, traditional 2D input function (such as mouse X/Y move, a left side/right side/wheel button state, wheel rotation) can be restricted to logical unit #18060.Master routine 8030 firmwares that can be write have two of separation from module, i.e. 2D data processing module 8040 and 3D data processing module 8050.The master routine 8030 of firmware limits all 2D function input data and all 2D functions are imported data processing is the packet of logical unit #18060.All 3D input functions (perhaps independently six-freedom degree input function) can be restricted to logical unit #28010.Master routine 8030 will limit all 3D function input data and all 3D functions are imported data processing is the packet of logical unit #28010.
Figure 33 shows the multi dimension device 9010 that is coupled to computing machine 9000.Multi dimension device 9010 connects 9020 via USB data is sent to Windows Embedded USB core driver 9030.This Windows Embedded USB core driver 9030 is positioned at Window inner nuclear layer 9040, and sends data to Windows Embedded USB mouse interface module 9050 and the user class interface module 9060 that is used for logical unit #2.These two modules send corresponding data to window application 9070.Therefore, when input media is connected to host PC by USB port, the Embedded USB driver of Microsoft will detect two independently USB devices (USB mouse and another USB input media), just as two USB input medias are arrived host PC by physical connection.
The use of this interface software thought based on a plurality of logical units do not have possibility with as incompatible by the future version of the current qualification of the mouse data bag that Microsoft limited and/or mouse data bag.
The standard of the packet of the equivalent 2D mouse of the mouse of Microsoft or Microsoft is defined as follows:
Table I
| |
The mouse |
| Byte | |
| 2 | Mouse X position data |
| Byte 3 | Mouse Y position data |
| Byte 4 | The wheel data |
The standard of listing above can be revised by adding 3D manipulation data as follows:
Table II
| |
The mouse |
| Byte | |
| 2 | Mouse X position |
| Byte 3 | Mouse Y position |
| Byte 4 | The wheel data |
| Byte 5 | |
| Byte 6 | |
| Byte 7 | 3D performance data 3 |
Necessary by the new logical unit in the firmware is defined as extended capability, use the interface method of a plurality of logical unit structures can easily add any new input control function, and need not to rewrite whole firmware.Below be the example implementation of this interface method:
(for example identical) with MS mouse data standard
Table III
| |
The mouse |
| Byte | |
| 2 | Mouse X position data |
| Byte 3 | Mouse Y position data |
| Byte 4 | The wheel data |
Table IV
| |
|
| |
|
| Byte 3 | 3D performance data 3 |
| Byte 4 | The 3D performance data |
Figure 34 shows interface software method 9100 according to exemplary embodiment, and this interface software method 9100 not only offers traditional 2D application program (such as MSWORD) but also offer and will go up the 2D/3D application program of operation in the operating system (such as Windows Vista operating system) in the future of supporting the 3D application program with the utilization of the input command of a plurality of degree of freedom.The generation that (being used for new 3D graphics application program) 3D uses specific order can utilize the RAWINPUT API equivalence bag in the future of the current RAWINPUT API of Windows XP or WindowsVista operating system.
The interface software method comprises the multi-dimensional input device 9110 that is coupled to computing machine 9240.This multi dimension device 9110 connects 9130 to Windows Embedded USB driver 9120 transmission data via USB.Windows Embedded USB driver 9120 is positioned at Windows inner nuclear layer 9140.Windows Embedded USB driver 9120 is carried data to the user class interface module 9150 that is used for logical unit #2.This user class interface module comprises user class USB/HID logical unit # 2 data acquisition module 9160, window message generation module 9170 and input report generation module 9180.User class USB/HID logical unit # 2 data acquisition module is given new 3D application program and window message generation module 9170 and input report generation module with data delivery.This window message generation module 9170 is carried data to Win32 message queue 9200, and this Win32 message queue 9200 is carried data to the Win322D application program.Input report generation module 9180 is carried data to Windows Vista figure demonstrating basis (Graphics Presentation Foundation) DLL 9220, and this Windows Vista figure demonstrating basis DLL 9220 carries data to Windows Vista 2D/3D application program 9230.
In operation, the manipulation of some traditional 2D Windows functions (such as the rolling of application window) realizes by sending corresponding message to windows messaging administration module (PresentationCore.dll and/or PresentationFramwork.dll among USER32.dll among the Win XP or the Windows Vista).Finish by sending corresponding message based on the manipulation of the Windows function (such as the rotation of the 2D application window among the 3D GUI in Windows Vista operating system) of 3D GUI to PresentationCore.dll and/or PresentationFramwork.dll.
Data acquisition module 9160 will be provided by the RAWINPUT API function that is provided by Microsoft, with the original input data of the logical unit # 2 on the retrieval Windows XP.The RAWINPUT API equivalent function bag that is used for Windows Vista is also provided by Microsoft.The detailed programming information of RAWINPUT API is provided by platform software developing instrument (" the SDK ") document of Microsoft.In a word, data acquisition module registration logical unit # 2 is to receive original input data.When logical unit # 2 sends packet, this data acquisition module will receive WM_INPUT message from the message queue of Windows.Then, this data acquisition module will use the GetRawInputData function to receive original input data.3D application program 9190 will obtain original input data by the function that calling program person limits, to transmit raw data to data acquisition module 9160 requests.
Windows messaging generation module 9170 among Figure 34 will send 2D software related news to Win32 message queue 9200 (part of USER32.dll), produce the 2D order with the raw data of utilizing logical unit #2.For example, if the user wants to use the top sensor 130 among Fig. 1 to be used for horizontal rolling 2D application program (such as electrical form), then by using Win32 function SendMassage (hwnd, WM HSCROLL, wParam, lParam), software can be used to convert the original input data of sensor 130 to be used to carry out horizontal rolling activation signal, and wherein hwnd is the input focus application in this environment, the handle of spreadsheet program.(wParam lParam) in fact place WM_HSCROLL message in Win32 message queue 9200, and this message is sent to input focus application (perhaps spreadsheet program) to function SendMassage then for hwnd, WM_HSCROLL.2D spreadsheet program retrieval WM_HSCROOL message, and the horizontal rolling cursor of using will be moved to horizontal direction.
Input reporting modules 9180 among Figure 34 will send the input report message (the Win32 message of equivalence) that Windows Vista limits to PresentationCore.dll among the Windows Vista and/or PresentationFramwork.dll, producing the 3D order, such as in the 3D gui environment, amplify, dwindle, deflection or rolling application-specific window.
Figure 35 shows the device 9400 of nine degree of freedom with programmable button and little lcd screen according to exemplary embodiment.In an illustrated embodiment, left sensor 9410, right sensor 9420 and top sensor 9430, left mouse button 9440, right mouse button 9450, wheel 9460, a plurality of user-programmable buttons 9470 and lcd screen 9480 are coupled to casing 9490.Casing 9490 is shapes of mouse health.Compare with the embodiment that describes among Fig. 1, in this embodiment, user-programmable buttons 9470 and little lcd screen 9480 are added to additional input media.
Figure 36-37 shows the interface method 9500 of the input media that comprises several disparate modules according to exemplary embodiment.In the embodiment shown in Figure 36, multi-dimensional input device 9510 comprises bottom sensor (not shown), left sensor 9520, right sensor 9530, top sensor 9540, left mouse button 9550, right mouse button 9560, wheel 9570, a plurality of programmable button 9580 and is coupled to the lcd screen 9590 of casing 9600.Casing 9560 is shapes of mouse health.Three sensors 9520,9530,9540 can produce the input control signal of the motion that is illustrated in six-freedom degree.Can represent by the logical unit #29610 that is used for the 3D input function by the input control signal that three sensors 9520,9530,9540 produce.Bottom sensor (not shown) and wheel 9570 can produce the input control signal of expression three degree of freedom.Represent by the logical unit #19620 that is used for the 2D mouse function by the input control signal that bottom sensor (not shown) and wheel 9570 (together with a left side and right mouse button 9550,9560) are produced.A plurality of buttons and lcd screen can be represented by the logical unit #39630 that is used for other input function.As shown in the figure, software can be developed and limit the 3rd logical unit, makes the function that can realize user-programmable buttons 9580 and little lcd screen 9590 realize.Any modification of logical unit #19620 or logical unit #29610 is added and do not required to function, and only require to add the software program of the data that are used for process user programmable button 9580 and little lcd screen 9590.
Figure 37 shows the multi dimension device that is coupled to the computing machine 9800 with three logical units.In the embodiment shown in Figure 37, multi-dimensional input device 9810 is coupled to computing machine 9890.This multi-dimensional input device connects 9830 to Windows Embedded USB core driver 9820 transmission data via USB.This Windows Embedded USB core driver is positioned at Windows inner nuclear layer 9840, and sends data to Windows Embedded USB mouse interface module 9850, the Subscriber Interface Module SIM 9870 that is used for the Subscriber Interface Module SIM 9860 of logical unit # 2 and is used for logical unit #3.Windows Embedded USB mouse interface module 9850, the Subscriber Interface Module SIM 9870 that is used for the Subscriber Interface Module SIM 9860 of logical unit # 2 and is used for logical unit #3 send data to window application 9880.As shown in the figure, computing machine 9890 detects three independently logical units from multi-dimensional input device 9810.
As discussed above, disclose and be used to make at the manipulation of six-freedom degree multi dimension device, method and interface easily.Though a plurality of illustrative aspects and embodiment have been discussed above, those skilled in the art are with its some modification of approval, displacement, interpolation and sub-portfolio.For example, though the main application of people disclosed herein/machine interface is as the multidimensional computer mouse etc., it also can be used to other control purpose, such as the control of industrial robot.Therefore, the claim intention of hereinafter introducing is interpreted as comprising all such modifications, displacement, interpolation and sub-portfolio, because they are all within its real spirit and scope.
Industrial applicibility
The present invention is the improvement of people/machine interface, and comprises mechanism, control circuit, firmware and software, to allow manipulating objects in hyperspace.
Claims (16)
1, a kind of multi-dimensional input device, it comprises:
Be suitable for the first sensor of finger manipulation, described first sensor can produce first input control signal and second input control signal, and described first input control signal and described second input control signal are illustrated in the motion of first degree of freedom and second degree of freedom,
Be suitable for second sensor of finger manipulation, described second sensor can produce the 3rd input control signal and the 4th input control signal, and described the 3rd input control signal and described the 4th input control signal are illustrated in the motion of Three Degree Of Freedom and four-degree-of-freedom,
Be suitable for the 3rd sensor of finger manipulation, described the 3rd sensor can produce the 5th input control signal and the 6th input control signal, described the 5th input control signal and described the 6th input control signal are illustrated in the motion of five degree of freedom and six degree of freedom, and
Be suitable for the casing that the user grasps with a hand;
Wherein, described first, second is coupled to described casing with the 3rd sensor and is positioned and allow described user to produce six input control signals of the motion that is illustrated in six-freedom degree with a hand.
2, multi-dimensional input device as claimed in claim 1, described casing further comprises:
The bottom surface that is suitable for sliding in the plane,
Be positioned at the sensor on the described bottom surface, this sensor can produce the 7th input control signal and the 8th input control signal, and described the 7th input control signal and described the 8th input control signal are illustrated in the motion of seven freedom and eight degrees of freedom.
3, multi-dimensional input device as claimed in claim 2, described casing further comprises:
End face,
Pivotally be coupled to the wheel of described end face, the described wheel is suitable for finger manipulation, and described the wheel can produce the 9th input control signal, and described the 9th input control signal is illustrated in the motion of nine-degree of freedom.
4, multi-dimensional input device as claimed in claim 1, wherein,
Described first degree of freedom is by the mobile expression along X-axis,
Described second degree of freedom represented by the angular motion around described X-axis,
Described Three Degree Of Freedom is by the mobile expression along Y-axis,
Described four-degree-of-freedom is by the mobile expression along the Z axle,
Described five degree of freedom represented by the angular motion around described Y-axis, and
Described six degree of freedom is by representing around the angular motion of described Z axle.
5, multi-dimensional input device as claimed in claim 2, wherein, described seven freedom and described eight degrees of freedom are by the mobile expression in two-dimentional X-Y plane.
6, multi-dimensional input device as claimed in claim 3, wherein, described nine-degree of freedom is by the mobile expression along the Z axle.
7, multi-dimensional input device as claimed in claim 1, wherein, described sensor is a touchpad sensor, described touchpad sensor produces the speed command signal that is used for three-dimensional applications.
8, multi-dimensional input device as claimed in claim 1, wherein, described sensor is the angle wheel component sensors, described angle wheel component sensors produces the speed command signal that is used for three-dimensional applications.
9, multi-dimensional input device as claimed in claim 1, wherein, described casing is a mouse body.
10, multi-dimensional input device as claimed in claim 1, wherein, described casing is integrated in the operating rod.
11, multi-dimensional input device as claimed in claim 10, wherein, institute's operating rod comprises:
Can produce the tracking ball of the 7th input control signal and the 8th input control signal, described the 7th input control signal and described the 8th input control signal are illustrated in the motion of seven freedom and eight degrees of freedom,
Operating rod handle with top and bottom, described operating rod handle can produce the 9th input control signal and the tenth input control signal, and described the 9th input control signal and described the tenth input control signal are illustrated in the motion of nine-degree of freedom and the tenth degree of freedom,
Base with top and bottom,
Wherein, the described bottom of described tracking ball, described mouse button and described operating rod handle is coupled to the described top of described base; And
Wherein, described casing is coupled to the described top of described operating rod handle.
12, multi-dimensional input device as claimed in claim 1 further comprises the hand-held controller that is coupled to described casing, and described hand-held controller comprises:
Tracking ball,
Right mouse button,
Left side mouse button,
Wheel,
A plurality of programmable digital buttons, and
The little lcd screen that is used for the display device state.
13, a kind of interface connecting system, it comprises:
Multi dimension device with a plurality of sensors, described a plurality of sensors comprise first group of sensor that can produce first group of input control signal and second group of sensor that can produce second group of input control signal, and
Be embedded in the firmware program in the described multi dimension device, described firmware program can produce the output of simulation first logical unit and second logical unit, described first logical unit is represented described first group of input control signal, and described second logical unit is represented described second group of input control signal;
Wherein, reception is operated as two independent logical devices of existence from the computing machine of the described output of described multi dimension device.
14, interface connecting system as claimed in claim 13, wherein, described first logical unit is handled two dimensional application.
15, interface connecting system as claimed in claim 14, wherein, described second logical unit is handled three-dimensional applications.
16, a kind of method that is used for multidimensional control, it comprises:
The first sensor that is suitable for finger manipulation is provided, described first sensor can produce first input control signal and second input control signal, described first input control signal and described second input control signal are illustrated in the motion of first degree of freedom and second degree of freedom
Second sensor that is suitable for finger manipulation is provided, described second sensor can produce the 3rd input control signal and the 4th input control signal, described the 3rd input control signal and described the 4th input control signal are illustrated in the motion of Three Degree Of Freedom and four-degree-of-freedom
The 3rd sensor that is suitable for finger manipulation is provided, described the 3rd sensor can produce the 5th input control signal and the 6th input control signal, described the 5th input control signal and described the 6th input control signal are illustrated in the motion of five degree of freedom and six degree of freedom, and
Provide and be suitable for the casing that the user grasps with a hand;
In the position that allows described user to produce six input control signals of the motion that is illustrated in six-freedom degree, described first, second arrived described casing with the 3rd sensors coupled with a hand.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US67955705P | 2005-05-09 | 2005-05-09 | |
| US60/679,557 | 2005-05-09 | ||
| US60/680,910 | 2005-05-13 | ||
| US11/323,574 | 2005-12-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101258536A true CN101258536A (en) | 2008-09-03 |
Family
ID=39892292
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006800250392A Pending CN101258536A (en) | 2005-05-09 | 2006-04-27 | Multidimensional input device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101258536A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102369500A (en) * | 2009-03-16 | 2012-03-07 | 尔格瓦克斯国际有限责任公司 | Mouse |
| CN102625929A (en) * | 2009-08-21 | 2012-08-01 | 摩托罗拉移动公司 | Tactile user interface for an electronic device |
| CN102778961A (en) * | 2011-05-12 | 2012-11-14 | 鸿富锦精密工业（深圳）有限公司 | Touch type mouse |
| CN103853349A (en) * | 2012-12-03 | 2014-06-11 | 联想(北京)有限公司 | Input device |
| CN107145251A (en) * | 2017-06-20 | 2017-09-08 | 庞瑞瑞 | A kind of finger tip input equipment |
| CN113823017A (en) * | 2021-09-17 | 2021-12-21 | 特斯联科技集团有限公司 | Face identification security protection intelligence lock |
-
2006
- 2006-04-27 CN CNA2006800250392A patent/CN101258536A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102369500A (en) * | 2009-03-16 | 2012-03-07 | 尔格瓦克斯国际有限责任公司 | Mouse |
| CN102625929A (en) * | 2009-08-21 | 2012-08-01 | 摩托罗拉移动公司 | Tactile user interface for an electronic device |
| CN102778961A (en) * | 2011-05-12 | 2012-11-14 | 鸿富锦精密工业（深圳）有限公司 | Touch type mouse |
| CN103853349A (en) * | 2012-12-03 | 2014-06-11 | 联想(北京)有限公司 | Input device |
| CN107145251A (en) * | 2017-06-20 | 2017-09-08 | 庞瑞瑞 | A kind of finger tip input equipment |
| CN113823017A (en) * | 2021-09-17 | 2021-12-21 | 特斯联科技集团有限公司 | Face identification security protection intelligence lock |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8009138B2 (en) | Multidimensional input device | |
| US7969418B2 (en) | 3-D computer input device and method | |
| US9939987B2 (en) | Method and apparatus for user interface of input devices | |
| US7696978B2 (en) | Enhanced cursor control using interface devices | |
| US20080062126A1 (en) | 3D method and system for hand-held devices | |
| CN101258536A (en) | Multidimensional input device | |
| JPH10260776A (en) | Contact type input equipment and position control method | |
| CN102830795A (en) | Remote control with motion sensitive device | |
| CN101673168B (en) | Method and device for selecting target object on interface | |
| JPH067371B2 (en) | 3D computer input device | |
| CN101063910A (en) | Pointing device for navigating three dimensional space using multiple finger actuated sensors | |
| US20080012828A1 (en) | Multi-dimensional input device | |
| Lee et al. | Design and empirical evaluation of a novel near-field interaction metaphor on distant object manipulation in vr | |
| CN100485587C (en) | Method and input device for providing position information to information handling systems | |
| US20020196232A1 (en) | Input device with two elastic fulcrums for six degrees of freedom data input | |
| CN112237736A (en) | Using touch sensing to make a trackball behave like a joystick | |
| CN102645986A (en) | Handheld electronic device with three-dimensional object | |
| Chen et al. | An integrated framework for universal motion control | |
| KR100636094B1 (en) | Three dimensional user input apparatus and input processing method thereof | |
| Barrera et al. | Real time detection interface for walking on CAVE | |
| JP3204237B2 (en) | Track ball | |
| JPH0337068Y2 (en) | ||
| Fukuchi | Concurrent Manipulation of Multiple Components on Graphical User Interface | |
| KR100311662B1 (en) | Method and device for controlling 3 dimension on screen | |
| Olivé | 6DOF Mouse Integration for Scientific and Medical Visualisation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20080903 |