CN103150058A - Human interface device and application method thereof - Google Patents
Human interface device and application method thereof Download PDFInfo
- Publication number
- CN103150058A CN103150058A CN2011104020689A CN201110402068A CN103150058A CN 103150058 A CN103150058 A CN 103150058A CN 2011104020689 A CN2011104020689 A CN 2011104020689A CN 201110402068 A CN201110402068 A CN 201110402068A CN 103150058 A CN103150058 A CN 103150058A
- Authority
- CN
- China
- Prior art keywords
- human
- interface device
- computer interface
- action
- inductor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a human interface device (HID) and an application method thereof. The HID comprises at least one sensor and at least one light source such as an infrared light source. The sensor has a function of identifying a position such as a pixel position and light intensity such as signal amplitude. The HID can be used for sensing and calculating the data of relative position or movement of a characteristic object such as a finger in at least one dimension (such as an X axis) perpendicular to a projection light central axis direction of the light source and the data of a relative depth value or movement of the characteristic object in one dimension (such as a Z axis) parallel to the projection line central axis direction of the light source, so that a corresponding two-dimensional coordinate or movement is synchronously generated on a two-dimensional display screen of a matched HID host to realize use functions of an ordinary mouse. Furthermore, an application program is matched to identify different signal combinations generated by various gestures to achieve using effects of a multifunctional HID and avoid numerous limitations to the use of related prior arts such as mousse or touch pads.
Description
Technical field
the present invention is relevant a kind of human-computer interface device (HID) and application process thereof, espespecially a kind ofly utilize at least one inductor it has the discriminating function of position such as picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude), and arrange in pairs or groups an infrared light sources and digital signal processing (DSP) function, with detect respectively and calculate a feature object on the 3rd axle Z axis of an X-axis and a correspondence relative position or the data of relative depth value and action, synchronously on two-dimentional display screen with the man-machine interface main frame (HID Host) that uses with its link one produce corresponding two-dimensional coordinate and action, use the result of use of reaching a multi-functional human-computer interface device.
Background technology
the User's Interface (user interface) of at present existing multiple different kenels or system and the application process of man-machine interface (HID, Human Interface Device) can generally be divided into touch and distance type User's Interface, wherein this touch User's Interface system comprises multiple different touch-control system and method such as resistance-type (Resistive), condenser type (Capacitive), surface acoustic wave type (SAW, Surface Acoustic Wave), infrared light formula (IR, Infrared), optical profile type (optical imaging) etc., it is directly to touch on a touch display screen with the various functions of controlling this display as clicking operation as finger or pointer by touch control object, image switching, zoom in/out picture or touch-control game etc., in order to replace general common button or rocker-type control mode.Distance type User's Interface system utilizes a feature object such as gesture or human body one position, make it produce the variation of relative position and action at an X, Y, Z three dimensions, to control the various functions of this display by remote control mode, namely this feature object does not directly touch on this display screen.In the correlative technology field of distance type User's Interface (user interface) system and method, had multiple prior art at present, comprise: PCT International Publication WO 03/071410; United States Patent (USP): US 7,348,963, US 7,433,024, US 6,560,019; U.S. Patent Publication No.: US 2008/0240502, US 2008/0106746, US 2009/0185274, US 2009/0096783, US 2009/0034649, US 2009/0185274, US 2009/0183125, US 2010/0020078 etc.; And Taiwan patent publication No.: 200847061,201033938,201003564,201010424,201112161 etc.
At this take a mouse as the example explanation, one has the optical mouse of rolling wheel, comprise wired or wireless mouse, be present one human-computer interface device (HID commonly used, Human Interface Device), it is to form a structure, generally be provided with left and right button and an intermediate roller on it, during use, the user holds with palm or operating mouse and with those buttons of finger presses or adopt this roller that rotates, with to computer such as desktop computer (PC), notebook computer (NB) but do not limit, control or input service.So, the mouse in related prior art has following shortcoming at least on using:
(1) existing mouse is all the operation that belongs to contact, and the user must as hold mouse with the hand contact and could operate; So, men and women user's hand such as palm or finger big or small different, if the housing structural body size of mouse is fixing, namely a mouse its size dimension after manufacturing is set, and this mouse not necessarily is applicable to any men and women user, therefore, the deviser of mouse or manufacturer, need or make in shape different designs in the size of the structure of mouse, to satisfy different users (consumer's) needs, relatively cause the puzzlement in manufacturing.
(2) the suitable space of the inner palpus tool of the structure of mouse is equipped with as left and right press button mechanism, wheel mechanism for rolling, optical facilities etc. for being installed with relevant electronics, and those mechanisms respectively have associated components, therefore the size of the structure of mouse thin, light, short and smallization effectively not only, and structure and composition member also can't be simplified effectively, relatively cause manufacturing cost effectively to reduce.
(3) existing mouse time that contact uses for a long time after, the mouse that configures for consumer's unility computer in place as open in bank, travel agency etc., shell body surface at mouse will inevitably grow a lot of bacteriums, does not meet the hygienic requirements that also is unfavorable for the consumer.
(4) existing mouse is confined to input coordinate in the use, click object, the elemental operation function such as (front and back) or left and right scrolling picture up and down, and can't reach the touch controllable function that present touch panel has, as touch panel can be directly by different gestures to produce different corresponding actions, can comprise with generation with different gestures as the user: vernier up/down/left/right moves, the scrolling form, amplify, dwindle, the multiple corresponding action such as picture/picture rotation, so, existing mouse but can't be by different gestures to produce the different corresponding actions such as above-mentioned.
As from the foregoing, in the technical field of human-computer interface device (HID) as mouse, develop and design a kind of pre-sizing that must not adopt and hold the also structure of contact operation for the user, and designs simplification, cost savings and meet human-computer interface device (HID) and the application process thereof that efficient requires have its desirability really.
Summary of the invention
fundamental purpose of the present invention is to be to provide a kind of human-computer interface device (HID) and application process thereof, and this human-computer interface device comprises at least one inductor and at least one light source as an infrared ray (IR light) light source, wherein this at least one inductor has the discriminating function of position such as picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude), the present invention utilizes this at least one inductor and the infrared ray of arranging in pairs or groups (IR light) light source and digital signal processing (DSP) function, in order to detect and to calculate a feature object, gesture as the user, be parallel to relative depth value on the one dimension (as Z axis) of projection light central axis direction of this light source or the data of action in the data of the relative position on the one dimension (as X-axis) of at least one projection light central axis direction perpendicular to this light source or action and one, for coordinate or the action that can synchronously produce corresponding two dimension on the two-dimentional display screen of a man-machine interface main frame that is used in combination (HID Host), use the basic use function of reaching a mouse.
still a further object of the present invention is to be to provide a kind of human-computer interface device (HID) and application process thereof, its application program of further can arranging in pairs or groups is produced different signal combination to produce corresponding action with the various different gesture of identification, can comprise with generation with different gestures as the user: vernier up/down/left/right moves, the scrolling form, amplify, dwindle, the multiple corresponding action such as picture/picture rotation, reach the result of use of a multi-functional human-computer interface device, and can avoid related prior art many restrictions in the use such as existing mouse or Trackpad (touch pad).
For reaching above-mentioned purpose, human-computer interface device of the present invention is to utilize at least one inductor and at least one light source to consist of, its can adopt built-in (embedded) mode or external (plug/play) mode with other man-machine interface main frame (HID Host) as the link such as computer, notebook computer, panel computer and be used in conjunction with; Wherein this at least one inductor can utilize a camera lens such as linear response device (Linear Sensor) or area inductor (Area Sensor) and closely connect inductor (proximity sensor) formation but do not limit, and uses the discriminating function with position such as picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude); Wherein this at least one light source can utilize an infrared ray (IR light) light source consist of but do not limit.on using, human-computer interface device of the present invention (HID) is to utilize this at least one inductor and this infrared ray of arranging in pairs or groups (IR light) light source and digital signal processing (DSP, digital signal processing) function, in order to detect and to calculate a feature object, as finger or gesture, one perpendicular to the data of the relative position on the one dimension (as X-axis) of the projection light central axis direction of this light source or action and the relative depth value on the one dimension (as Z axis) of a projection light central axis direction that is parallel to this light source far and near direction of this light source (namely with respect to) or the data of action, use synchronous coordinate or the action that produces corresponding two dimension on the two-dimentional display screen of this man-machine interface main frame (HID Host), use the use function of completing a mouse.
The digital element signal of human-computer interface device of the present invention (HID) recycling system software is processed (DSP) function, further the collocation application program is produced different signal combination with the various different gesture of identification, and then produce corresponding action, use and allow the user comprise with generation with different gestures: vernier up/down/left/right moves, the scrolling form, amplify, dwindle, the multiple corresponding action such as picture/picture rotation, reach the result of use of a multi-functional human-computer interface device.
By human-computer interface device of the present invention (HID) and application process thereof, not only can reach the basic use function of a mouse, more can reach the various different gestures of identification producing the result of use of corresponding action, and can avoid related prior art many restrictions in the use such as existing mouse or Trackpad (touch pad); Therefore human-computer interface device of the present invention and related prior art relatively have advantages of method simplification, designs simplification, cost and easy to use.
Description of drawings
Fig. 1 is system architecture and the mode of operation schematic perspective view of human-computer interface device one embodiment of the present invention;
Fig. 2 be the system architecture of man-machine interface arrangement one embodiment of the present invention and mode of operation on look key diagram;
Fig. 3-5 are respectively three kinds of key diagrams that use state of human-computer interface device of the present invention;
Fig. 6 is human-computer interface device detecting one feature object of the present invention and produces the discriminating function key diagram of picture element position;
Fig. 7 is human-computer interface device detecting one feature object of the present invention and the discriminating function key diagram that produces light intensity (signal amplitude value);
Fig. 8 is human-computer interface device detecting one feature object of the present invention and the discriminating function key diagram that produces simultaneously picture element position and light intensity (signal amplitude value);
Fig. 9 A-9E is respectively that human-computer interface device of the present invention moves gesture, scrolling form gesture, amplifies the picture gesture, dwindles the key diagram of the signal combination of picture gesture and picture/different gestures such as picture rotation gesture in order to identification vernier up/down/left/right;
Figure 10 is that human-computer interface device of the present invention dwindles the variation key diagram of signal combination on X-axis of picture gesture (as shown in Fig. 9 D) in order to identification;
Figure 11 is that human-computer interface device of the present invention dwindles the variation key diagram of signal combination on Z axis of picture gesture (as shown in Fig. 9 D) in order to identification;
Figure 12 is the systemic-function block schematic diagram of human-computer interface device of the present invention;
Figure 13 is the schematic flow sheet of action method one embodiment of human-computer interface device of the present invention.
Description of reference numerals: 10-human-computer interface device; The 20-inductor; The 21-camera lens; 22-closely connects inductor; 23-normal (sensitive surface); The 30-light source; 30a-throws scope; 31-projection light central shaft; 40-man-machine interface main frame; The 41-display screen; 50,50a, 50b-feature object; X
1, X
2-signal value output; Δ X-(signal value output) phase difference; Z
1, Z
2-light intensity (signal amplitude value); Δ Z-(light intensity) phase difference.
Embodiment
For making the present invention more clear and definite full and accurate, coordinate following diagram to describe in detail structure of the present invention, technical characterictic and method for designing as after:
Shown in figure 1-5, its be human-computer interface device of the present invention (HID, a Human Interface Device) embodiment system architecture and mode of operation schematic perspective view, on look key diagram and three different use state description figure.Human-computer interface device 10 of the present invention comprises at least one inductor 20 and at least one light source 30 as shown in Figure 1, 2, and it is in order to link to be used in conjunction with as shown in Fig. 3-5 with other man-machine interface main frames (HID Host) 40.In Fig. 1,2, general this at least one inductor 20 can utilize a camera lens 21 VGA camera lens and as linear response device (Linear Sensor) or area inductor (Area Sensor) etc. closely connect inductor (proximity sensor) 22 formations as shown in Figure 1, 2 but do not limit, and uses the discriminating function (describing in detail again after appearance) with position such as picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude); Wherein this camera lens 21 and this closely connect inductor (proximity sensor) 22 and can be designed to the individuality opened in two minutes as shown in Figure 2, or the single assembly of design forming one be inductor 20 as shown in Figure 1, this can need and determine applicable pattern between individual or single individuality respectively two with the price of market specifications product and design.
This at least one light source 30 can utilize an invisible light such as infrared ray (IR light) light source consist of but do not limit, to avoid being subject to the interference of other visible lights in operating environment.
This man-machine interface main frame (HID Host) 40 comprises computer, notebook computer, panel computer etc. but does not limit, and is take a notebook computer as the example explanation as shown in Fig. 3-5.Human-computer interface device 10 of the present invention is when being used in conjunction with other man-machine interface main frames (HID Host) 40, and the mode of connection between does not both limit, can adopt built-in (embedded) mode as shown in Figure 3 or external mode as shown in Fig. 4,5.When built-in (embedded) mode of employing, this human-computer interface device 10 is that built-in (embedded) is at the internal edge place of this man-machine interface main frame (notebook computer) 40, this human-computer interface device 10 is arranged on as shown in Figure 3 the right-hand corner end of this notebook computer, so that can outwards carry out detecting function.When adopting external mode, this human-computer interface device 10 can utilize wired mode, as utilize a connecting interface (interface) and be linked to this man-machine interface main frame (notebook computer) 40 in wired external mode, wherein this connecting interface (interface) comprises but does not limit: USB (Universal Serial Bus, USB (universal serial bus)), 1394 connecting interfaces and Thunderbolt connecting interface (American I ntel company design).This human-computer interface device 10 also can utilize wireless mode, as utilize a wireless communication mode and be linked to this man-machine interface main frame (notebook computer) 40 in wireless external mode, wherein this wireless communication mode comprises but does not limit: bluetooth (Bluetooth), wireless network (WiFi), near-field communication (NFC, Near Field Communication), wireless (radio frequency) transceiver such as 2.4GHz RF Transceiver.
on using, human-computer interface device of the present invention (HID) is to utilize position that this at least one inductor 20 has such as the discriminating function of picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude) (this signal amplitude value is generally magnitude of voltage), and this infrared ray of arranging in pairs or groups (IR light) light source 30 and digital signal processing (DSP, digital signal processing) function, in order to detect and to calculate a feature object 50, finger or gesture as shown in Fig. 1-2 but do not limit, one perpendicular to the relative position on the one dimension (X-axis as shown in Fig. 1-5) of projection light central shaft 31 directions of this light source 30 or the data of action, and the relative depth value on another dimension (Z axis as shown in Fig. 1-5) of projection light central shaft 31 directions that are parallel to this light source 30 far and near direction of this light source 30 (namely with respect to) or the data of action, use synchronous coordinate or the action that produces corresponding two dimension on the two-dimentional display screen 41 of this man-machine interface main frame (HID Host) 40.in other words, human-computer interface device 10 of the present invention is two dimension (2-D) the location identification functions on this X-Z axle by these at least one inductor 20 haves, obtain data with this feature object 50 relative position or action on this X-Z axle with detecting and calculating, and then conversion and synchronous coordinate or the action that produces corresponding two dimension on the two-dimentional display screen 41 of this man-machine interface main frame (HID Host) 40, use the basic use function of completing a mouse, as comprise input coordinate, click object, (front and back) or left and right scrolling picture etc. use function substantially up and down.
With the embodiment shown in Fig. 1-5, though this above-mentioned X-axis is defined as direction perpendicular to the projection light central shaft 31 of this light source 30 at this, but be not the direction that limits this X-axis, namely this X-axis also may be defined as perpendicular to the direction of the normal 23 of the photoinduction face (receiving plane) of this inductor 20 as shown in Figure 1, or be defined as perpendicular to this camera lens 21 or closely connect inductor (proximity sensor) 22 photoinduction face (receiving plane) normal 23 direction as shown in Figure 2.More say it, though this above-mentioned Z axis is defined as a direction that is parallel to the projection light central shaft 31 of this light source 30 far and near direction of this light source 30 (namely with respect to) at this, but be not the direction that limits this Z axis, namely this Z axis also may be defined as the photoinduction face (receiving plane) that is parallel to this inductor 20 normal 23 direction as shown in Figure 1, be defined as be parallel to this camera lens 21 or closely connect inductor (proximity sensor) 22 photoinduction face (receiving plane) normal 23 direction as shown in Figure 2.
As follows at this discriminating function that further illustrates this at least one inductor 20 has position such as picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude):
At first, this inductor 20 that the man-machine interface arrangement of the present invention (HID) 10 uses or this camera lens 21 wherein, be mainly in order to feature object 50, finger or gesture as shown in Fig. 1-2 but do not limit produce the discriminating function of position such as picture element (pixel) position.Shown in figure 2,6, it is to utilize this inductor 20 (or this camera lens 21) and pass through mat digital signal processing (DSP, digital signal processing) function, in order to detect and to calculate a feature object 50, as user's finger or gesture but do not limit, relative position and action data in the upper X-axis as shown in Fig. 1-5 of an one dimension (1-D, 1-Dimention).Take Fig. 2,6 as the example explanation, when this feature object 50 moves to a second place (pointer 2) by a primary importance (pointer 1), can detect respectively signal value output (signal output value) X in two positions of primary importance and the second place by this inductor 20 (or this camera lens 21)
1, X
2, and these two signal value outputs (signal output value) X
1, X
2Phase difference on X-axis (Δ X), this phase difference (Δ X) namely represents the displacement on X-axis when moving to the second place (pointer 2) by primary importance (pointer 1), by digital signal processing (DSP) function, coordinate or the action that can synchronously produce corresponding one dimension (X-axis) on two dimension (2-D, the 2-Dimention) display screen 41 of this man-machine interface main frame (HID Host) 40.
Again and, this inductor 20 that the man-machine interface arrangement of the present invention (HID) 10 uses or wherein this closely connects inductor (proximity sensor) 22, mainly in order to feature object 50, finger or gesture as shown in Fig. 1-2 but do not limit produce the discriminating function of light intensity such as signal amplitude value (Signal Amplitude).Shown in figure 2,7, it is to utilize this inductor 20 (or this closely connects inductor 22) and mat digital signal processing (DSP, digital signal processing) function, in order to detect and to calculate a feature object 50, as user's finger or gesture but do not limit, at the upper Z axis as shown in Fig. 1-5 of another dimension (1-D, 1-Dimention), relative position and action data.Take Fig. 2,7 as the example explanation, when this feature object 50 moves to a second place (pointer 2) by a primary importance (pointer 1), can detect respectively light intensity such as signal amplitude value (Signal Amplitude value) Z in two positions of primary importance and the second place by this inductor 20 (or should or this closely connect inductor 22)
1, Z
2, and these two light intensities such as signal amplitude value Z
1, Z
2Phase difference on Z axis (Δ Z), namely represent the displacement on Z axis when moving to the second place (pointer 2) by primary importance (pointer 1), by digital signal processing (DSP) function, coordinate or the action that can synchronously produce another corresponding dimension on two dimension (2-D, the 2-Dimention) display screen 41 of this man-machine interface main frame (HID Host) 40 that is used in combination.
This closely connects inductor (proximity sensor) the 22nd, and this infrared ray of arranging in pairs or groups (IR light) light source 30 uses, this infrared light sources 30 is the infrared rays towards the direction of feature object 50 projection some strength, makes this ultrared projection scope 30a can comprise the position of feature object 50 and contains arround this feature object 50 a scope zone.This closely connects inductor (proximity sensor) 22 in order to this ultrared reflected light of induction, especially responds to the rear infrared ray that reflects that this infrared ray is incident upon this feature object 50.When feature object 50 produces relatively moving of Z-direction, this ruddiness line source 30 is incident upon the rear ruddiness linear light intensity that reflects of feature object 50, the variation that signal amplitude value described above (Signal Amplitude value) will produce a degree, for example: when this feature object 50 is during relatively forward near this infrared light sources 30 in the movement of Z-direction, this closely connects the inductor 22 ruddiness linear light intensity of sensing (signal amplitude value) and will relatively become large (enhancing); When this feature object 50 in the movement of Z-direction for relatively leaving backward this infrared light sources 30, this closely connects the inductor 30 ruddiness linear light intensity of sensing (signal amplitude value) will relatively diminish (weakening); Therefore closely connect the relative enhancing of the inductor 22 ruddiness linear light intensity of sensing (signal amplitude value) or the variation that weakens by this, can in order to detect this feature object 61 the movement of Z-direction be relatively forward near or leave backward this infrared light sources 40.Therefore this closely connects inductor 22 collocation this infrared ray (IR light) light sources 30 and uses, and again by digital signal processing (DSP) function, can be in order to detect and to calculate this feature object 50 with respect to the relative depth Value Data on another dimension (Z axis) of this one dimension (X-axis), and then coordinate or the action that can synchronously produce another corresponding dimension on two dimension (2-D, the 2-Dimention) display screen 41 of this man-machine interface main frame (HID Host) 40 that is used in combination.
When this camera lens 21 and this closely connect the inductor 22 single assemblys of design forming one namely during this inductor 20 as shown in Figure 1, with reference to shown in Figure 8, when this feature object 50 moves to a second place (pointer 2) by a primary importance (pointer 1), can detect simultaneously two signal value outputs (signal output value) X on X-axis by this inductor 20
1, X
2With its phase difference (Δ X) and two light intensities on Z axis such as signal amplitude value (Signal Amplitude value) Z
1, Z
2With its phase difference (Δ Z), by digital signal processing (DSP) function, coordinate or the action that can synchronously produce corresponding two dimension on two dimension (2-D, the 2-Dimention) display screen 41 of this man-machine interface main frame (HID Host) 40 that is used in combination.
human-computer interface device of the present invention (HID) the 10th utilizes the digital element signal of system software to process (DSP) function, so that above-mentioned by the X-axis coordinate of these camera lens 21 gained or the data of action, further with closely connect the Z axis coordinate of inductor 22 gained or the data of action by this and be coupled, in order to calculate this feature object 50 (as finger) at relative position and the action data of this X-Z two-dimensional space (on the desktop as human-computer interface device 10 the place aheads), be the coordinate of X-Z axle or the data of action, supply exportable this feature object 50 in the coordinate of X-Z two-dimensional space or the data of action, with corresponding two-dimensional coordinate or the action of synchronous generation on this two dimension display screen 41.In other words, the Main Function effect of the man-machine interface arrangement of the present invention (HID) 10 is: two-dimensional coordinate or action on the X-Z axle of obtaining according to 20 detectings of this inductor and calculating, convert thereof into the two-dimentional display screen 41 corresponding to this man-machine interface main frame (HID Host) 40, make synchronous two-dimensional coordinate or the action that produces corresponding to this X-Z axle on this two dimension display screen 41.X-Z axle two-dimensional coordinate or the action namely defined by this inductor 20 convert two-dimensional coordinate or the action that this two dimension display screen 41 defines accordingly to.So, human-computer interface device of the present invention (HID) the 10 basic use function that can reach general mouse as carry out input coordinate on display screen 41, click object, the operation function such as (front and back) or left and right scrolling picture up and down.
In addition, human-computer interface device of the present invention (HID) 10 more can utilize position that this at least one inductor 20 has such as the discriminating function of picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude), and the further application program that built of collocation system again, produce different signal combination for the various different gesture of identification, and then produce corresponding action, use allowing the user can be with different gestures to produce multiple corresponding action.For example, the user can be in reach zone, the place ahead of this at least one inductor 20, and carry out various different gestures as comprising but do not limit: vernier up/down/left/right moves gesture as shown in Fig. 9 A; Scrolling form gesture is as shown in Fig. 9 B; Amplify the picture gesture as shown in Fig. 9 C; Dwindle the picture gesture as shown in Fig. 9 D; Picture/picture rotation gesture multiple different gestures such as shown in Fig. 9 E, human-computer interface device of the present invention (HID) 10 can those different gestures of identification produce different signal combination, and then produce corresponding action, reach the result of use of a multi-functional human-computer interface device.
At this take the gesture of " dwindling " shown in Fig. 9 D as the example explanation, please refer to shown in Fig. 9 D and Figure 10,11, as two feature object 50a, 50b, as the user with thumb (pointer 1) when feature object 50a and with forefinger (pointer 2) as feature object 50b, when carrying out in opposite directions near action in the reach of the place ahead of this at least one inductor 20, be to be similar to present cellie to carry out akin folder with thumb and forefinger receive near action and for being used for, picture is dwindled on touch panel near action in opposite directions at this this thumb 50a and forefinger 50b; This two features object 50a, 50b First Characteristic object 50a (pointer 1) and the Second Characteristic object 50b (pointer 2) as shown in Fig. 9 D, will produce as Figure 10,11 variations that are shown on X-axis and Z axis, comprise: as shown in figure 10 by the X on X-axis
1a, X
2aAnd Δ X
aThe position transition that defines is extremely by the X on X-axis
1b, X
2b, Δ X
bThe position of defining; Simultaneously as shown in figure 11 by the Z on Z axis
1c, Z
2c, Δ Z
cThe position transition that defines is extremely by the Z on Z axis
1d, Z
2d, Δ Z
dThe position of defining.Human-computer interface device of the present invention (HID) 10 gets final product the application program that collocation system builds, the signal combination that gesture was produced of " dwindling " with this representative of further identification, namely this two features object 50a, 50b are producing as Figure 10 and change in location shown in Figure 11 on X-axis and on Z axis, and then produce corresponding action on this two dimension display screen 41, namely make the picture of this two dimension display screen 41 produce corresponding " dwindling " action.
in like manner, human-computer interface device of the present invention (HID) 10 gets final product the application program that collocation system builds, the signal combination that is produced with the different gestures of further identification, move gesture as shown in Fig. 9 A as vernier up/down/left/right, scrolling form gesture is as shown in Fig. 9 B, amplify the picture gesture as shown in Fig. 9 C, dwindle the picture gesture as shown in Fig. 9 D, picture/picture rotation gesture multiple different gesture such as shown in Fig. 9 E produces different signal combination, and then the corresponding action of generation on this two dimension display screen 41, reach the result of use of a multi-functional human-computer interface device.And above-mentioned result of use, be that the different gestures of identification are to produce corresponding action on this two dimension display screen 41, be that existing idler wheel mouse can't the person of reaching, therefore human-computer interface device 10 of the present invention compares as existing any mouse with related prior art, have advantages of method simplification, designs simplification, cost, easy to use, especially more with the touch controllable function of the various gestures of touch panel.
Again with reference to shown in figure 1,2, in human-computer interface device of the present invention (HID) 10, this inductor 20 can arrange to be arranged on the same structure body as shown in Figure 1 with this infrared ray (IR light) light source 30; Or this inductor 20 is divided into again a camera lens 21 and and closely connects inductor 22, and arrange to be arranged on the structure of same human-computer interface device (HID) 10 with this infrared ray (IR light) light source 30 again, but be not to limit this both or the structure arrangement between the three; Namely, this camera lens 21, closely connect on the structure that inductor 22 and infrared light sources 30 can be arranged on same human-computer interface device (HID) 10 as shown in Figure 1, 2, also can separately be arranged on different structures, or in the three wantonly two can be in conjunction with being arranged on the same structure body, therefore various structural design is arranged on structure arrangement, can select wherein best mode with fabricator or user's convenience.This camera lens 21 in the present embodiment, infrared light sources 30 and closely to connect inductor 22 be sequentially to arrange to be arranged in a straight line in the structure of this human-computer interface device (HID) 10 again, but be not position and the arrangement mode that limits between this three, namely, this camera lens 21, infrared light sources 30 and closely connect inductor 22 and can sequentially not arrange also can not be arranged to a vertical or horizontal line spread.But for promoting service efficiency and the convenience of inventor's machine interface system 10, can be coupled with a dimension coordinate of this Z axis or the data of action efficiently as the dimension coordinate that makes this X-axis in subsequent step or the data of action, therefore this camera lens 21, infrared light sources 30 and closely connect the action direction of inductor 22 and scope to form overlap condition for better but do not limit, namely, this camera lens 21 of the present invention, infrared light sources 30 reach closely to connect action direction and the scope of inductor 22 and do not require and must form overlap condition for best as far as possible.
for disclosed system software or its digital signal processing that has (DSP) function, can provide but not limit a processor (processor) as digital signal processor (DSP, Digital Signal Processor) or little processing and control element (PCE) (MCU, Microcontroller Unit, or title microcontroller) digital signal processing (DSP) function that is had to reach these system software or its, therefore those system softwares or its digital element signal that has are processed in the structure that (DSP) function can be established in human-computer interface device of the present invention (HID) 10 as shown in figure 12, also can be established in (not shown) in this man-machine interface main frame (the HID Host) 40 that is used in combination.
With reference to shown in Figure 12, it is the block schematic diagram of systemic-function one embodiment of human-computer interface device of the present invention, also can be considered Fig. 4 or two kinds of key diagrams that use state shown in Figure 5.the human-computer interface device 10 of the present embodiment is except comprising at least one inductor 20 (comprise camera lens 21 and closely connect inductor 22) and at least one light source 30, further can comprise: a little processing and control element (PCE) (MCU, Microcontroller Unit, or claim microcontroller) 11 but do not limit, one analog-digital converter (analog-to-digital vonverter), 12 and one light source control circuit (light source control circuit) 13, in order to be connected to respectively and to control this inductor 20 (comprise camera lens 21 and closely connect inductor 22), this light source 30 and this man-machine interface main frame (HID Host) 40 are as shown in figure 12, use the use effect of reaching a mouse or a multi-functional HID.Wherein this little processing and control element (PCE) (MCU, Microcontroller Unit) 11 also can be digital signal processor (DSP, Digital Signal Processor).
this inductor 20 or this camera lens 21 that comprise with regard to human-computer interface device 10 of the present invention closely connect inductor 22 with this, this infrared light sources 30, the functional devices such as this display 41 and digital signal processing (DSP) function of utilizing, due to above-mentioned each functional devices (20, 21, 22, 30, 40) and digital signal processing (DSP) function etc., all can utilize the prior art of the art to reach the action function of each functional devices in the present invention itself, and these functional devices (20, 21, 22, 30, 40) and digital signal processing (DSP) function individual itself, it is not the technical characteristics of human-computer interface device 10 of the present invention and method thereof, therefore separately do not describe again each individual action function own in detail.
With reference to shown in Figure 13, it is the schematic flow sheet of action method one embodiment of human-computer interface device 10 of the present invention.The action method of human-computer interface device 10 of the present invention comprises the following step:
Step 61: at least one inductor 20 (21,22) and at least one light source 30 are provided; Wherein this at least one inductor 20 (21,22) has the discriminating function of picture element (pixel) position and light intensity such as signal amplitude value (Signal Amplitude); Wherein this signal amplitude value is generally magnitude of voltage;
Step 62: utilize this at least one inductor 20 and this at least one light source 30, in order to detect a feature object 50 in picture element (pixel) position and the signal amplitude value (Signal Amplitude) of this at least one inductor 20;
Step 63: carry out pre-service, calculating this feature object 50 in the data of the relative position (X coordinate) of an one dimension (X-axis) and action, and in the data of the relative depth value (Z coordinate) of another dimension (Z axis) and action; And
Step 64: export the relative position (X-Z coordinate) in two dimension (X-Z) space of this feature object 50 and the data of action.
wherein, in this step 64, the present invention is the digital element signal processing function that utilizes system software, so that the data of a dimension coordinate of this X-axis or action further are coupled with the data of this Z axis one dimension coordinate or action, in order to calculate this feature object 50 in the relative position of this X-Z axle two-dimensional space and the data of action, the man-machine interface main frame (HID Host) 40 that the data to of exporting the relative position (being the X-Z coordinate) of the two-dimensional space of this feature object 50 again and moving are used in combination, use synchronous coordinate or the action that produces corresponding two dimension on a two-dimentional display screen 41 of this man-machine interface main frame (HID Host) 40, use the application of controlling this display screen 41.
Being only the preferred embodiments of the present invention shown in above, is only illustrative for the purpose of the present invention, and nonrestrictive.Common knowledge personnel understand at this professional skill field tool, can carry out many changes to it in the spirit and scope that claim of the present invention limits, revise, and the even change of equivalence, but all will fall within the scope of protection of the present invention.
Claims (17)
1. a human-computer interface device, is characterized in that, it is to use in order to link for the user with at least one man-machine interface main frame, and wherein this man-machine interface main frame has at least one two-dimentional display screen, and this human-computer interface device comprises:
At least one inductor, it is the discriminating function with picture element position and light intensity, in order to detect relative position or the action of at least one feature object on an X-Z axle two dimensional surface, to produce corresponding X-Z axle two-dimensional coordinate or the data of action, wherein this X-axis is be defined as one perpendicular to the direction of the projecting beam central shaft of this light source or be the direction perpendicular to the normal of the photoinduction face of this inductor, this Z axis be defined as one be parallel to this light source the projecting beam central shaft direction or be the direction of the normal of the photoinduction face that is parallel to this inductor;
At least one light source, its be in order to outside projecting beam to form a projection scope on this X-Z axle two dimensional surface so that move in the projection scope of this characteristic body physical efficiency on this X-Z axle two dimensional surface, detect for this at least one inductor;
Wherein when using, discriminating function and this light source of arranging in pairs or groups that this human-computer interface device utilizes this at least one inductor to have, in order to detect and to calculate this feature object in the data of the relative position on X-axis or action and the relative depth value on Z axis or the data of action, and the data of exporting again the X-Z axle two-dimensional coordinate of this feature object or action are to this man-machine interface main frame, for synchronous coordinate or the action that produces corresponding two dimension on the two-dimentional display screen of this man-machine interface main frame, to reach the result of use of a man-machine interface.
2. human-computer interface device according to claim 1, it is characterized in that, this human-computer interface device further comprises: a little processing and control element (PCE), an analog-digital converter and a light source control circuit, and in order to be electrically connected to respectively this at least one inductor, this at least one light source and this man-machine interface main frame to reach the result of use of a man-machine interface.
3. human-computer interface device according to claim 1, it is characterized in that, this at least one inductor is to comprise a camera lens closely to connect inductor in order to detect relative position or the action of a feature object on a Z axis in order to detect a feature object at the relative position on this X-axis or action and.
4. human-computer interface device according to claim 3, it is characterized in that, this closely connects inductor is that this light source of collocation uses, this light source is the light beam towards the projection scope projection some strength that comprises this characteristic body body position, this closely connects inductor in order to the variation of the catoptrical light intensity responding to this projecting beam and reflected by the feature object, with the coordinate that forms Z axis or the data of action.
5. human-computer interface device according to claim 1, is characterized in that, this light intensity is a signal amplitude value, and this signal amplitude value is a magnitude of voltage.
6. human-computer interface device according to claim 1, is characterized in that, this light source is infrared light sources.
7. human-computer interface device according to claim 1, is characterized in that, this man-machine interface main frame comprises computer, notebook computer, panel computer.
8. human-computer interface device according to claim 1, is characterized in that, this human-computer interface device is to adopt built-in mode or external mode to link with this man-machine interface main frame.
9. human-computer interface device according to claim 8, it is characterized in that, when this human-computer interface device adopts built-in mode when linking with this man-machine interface main frame, this human-computer interface device is built the internal edge place of this man-machine interface main frame in being in, so that this human-computer interface device can outwards carry out detecting function.
10. human-computer interface device according to claim 8, it is characterized in that, when this human-computer interface device adopts external mode when linking with this man-machine interface main frame, this human-computer interface device is to utilize a connecting interface and be linked to this man-machine interface main frame in wired external mode.
11. human-computer interface device according to claim 10 is characterized in that, this connecting interface comprises: USB, 1394 connecting interfaces, Thunderbolt connecting interface.
12. human-computer interface device according to claim 8, it is characterized in that, when this human-computer interface device adopts external mode when linking with this man-machine interface main frame, this human-computer interface device is to utilize a wireless communication mode and be linked to this man-machine interface main frame in wireless external mode.
13. human-computer interface device according to claim 12 is characterized in that, this wireless communication mode comprises: bluetooth, wireless network, near-field communication, rf receiver and transmitter, described rf receiver and transmitter are 2.4GHz RF Transceiver.
14. human-computer interface device according to claim 1, it is characterized in that, this human-computer interface device is to detect according to this inductor X-Z axle two-dimensional coordinate or the action that obtains this feature object, and with its conversion with synchronous two-dimensional coordinate or the action that produces corresponding to this X-Z axle on this two dimension display screen, can carry out input coordinate on this display screen, click object, up and down or the operation function of left and right scrolling picture for the user.
15. human-computer interface device according to claim 1, it is characterized in that, this human-computer interface device further utilizes picture element position that this at least one inductor has and the discriminating function of light intensity, and collocation application program, produced different signal combination with further identification with the different gesture that two these characteristic body bodies form, and then produce corresponding action, can be with different gestures to produce multiple corresponding action for the user, wherein this different gesture comprises: on vernier, under, left, gesture moves right, scrolling form gesture, amplify the picture gesture, dwindle the picture gesture, the picture rotate gesture.
16. the application process of a human-computer interface device is characterized in that, comprises the following step:
Step 1: a human-computer interface device is provided, and it comprises at least one inductor and at least one light source, the discriminating function of this at least one inductor with picture element position and light intensity wherein, and wherein this light intensity is a signal amplitude value;
Step 2: utilize this at least one inductor and this at least one light source to detect at least one feature object in picture element position and the signal amplitude value of this at least one inductor;
Step 3: carry out pre-service, to calculate this feature object in the data of the X of one dimension X-axis coordinate and action and to be the data of Z coordinate and action in another relative depth value of tieing up Z axis; And
Step 4: export the X-Z coordinate of X-Z axle two-dimensional space of this feature object and the data of action.
17. the application process of human-computer interface device according to claim 16, it is characterized in that, this step 4 is to utilize the digital signal processing function of system software, so that the data of a dimension coordinate of this X-axis or action further are coupled with the data of this Z axis one dimension coordinate or action, in order to calculate this at least one feature object in the relative position of this X-Z axle two-dimensional space and the data of action, the relative position of exporting again the two-dimensional space of this feature object is the man-machine interface main frame that the data to of X-Z coordinate and action are used in combination, use synchronous coordinate or the action that produces corresponding two dimension on a two-dimentional display screen of this man-machine interface main frame, use the application of controlling this display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104020689A CN103150058A (en) | 2011-12-06 | 2011-12-06 | Human interface device and application method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104020689A CN103150058A (en) | 2011-12-06 | 2011-12-06 | Human interface device and application method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103150058A true CN103150058A (en) | 2013-06-12 |
Family
ID=48548179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011104020689A Pending CN103150058A (en) | 2011-12-06 | 2011-12-06 | Human interface device and application method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103150058A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117005A (en) * | 2015-08-17 | 2015-12-02 | 湖南迪文科技有限公司 | Light sensing based gesture identification system and method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060161870A1 (en) * | 2004-07-30 | 2006-07-20 | Apple Computer, Inc. | Proximity detector in handheld device |
| CN101963840A (en) * | 2009-07-22 | 2011-02-02 | 罗技欧洲公司 | Be used for system and method long-range, the virtual screen input |
| WO2011085023A2 (en) * | 2010-01-06 | 2011-07-14 | Celluon, Inc. | System and method for a virtual multi-touch mouse and stylus apparatus |
-
2011
- 2011-12-06 CN CN2011104020689A patent/CN103150058A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060161870A1 (en) * | 2004-07-30 | 2006-07-20 | Apple Computer, Inc. | Proximity detector in handheld device |
| CN101963840A (en) * | 2009-07-22 | 2011-02-02 | 罗技欧洲公司 | Be used for system and method long-range, the virtual screen input |
| WO2011085023A2 (en) * | 2010-01-06 | 2011-07-14 | Celluon, Inc. | System and method for a virtual multi-touch mouse and stylus apparatus |
Non-Patent Citations (1)
| Title |
|---|
| 陕西档案: "解放右手的evoMouse鼠标", 《陕西档案》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117005A (en) * | 2015-08-17 | 2015-12-02 | 湖南迪文科技有限公司 | Light sensing based gesture identification system and method |
| CN105117005B (en) * | 2015-08-17 | 2018-09-14 | 湖南迪文科技有限公司 | Gesture recognition system based on light sensing and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI556134B (en) | Handheld electronic devices and methods for controlling a handheld electronic device | |
| CN104679362B (en) | Touch device and control method thereof | |
| US20120044095A1 (en) | Capacitive-matrix keyboard with multiple touch detection | |
| EP2778849A1 (en) | Method and apparatus for operating sensors of user device | |
| JP2014509768A (en) | Cursor control and input device that can be worn on the thumb | |
| CN203276188U (en) | Computer input device | |
| US20140267025A1 (en) | Method and apparatus for operating sensors of user device | |
| CN105718088A (en) | Computer system | |
| CN103605433B (en) | A kind of Multifunctional somatological input device | |
| CN203276248U (en) | Touch screen capable of sensing touch positions and pressure | |
| CN103019449A (en) | Three-dimensional multi-point type touch screen based on pressure sensor | |
| CN103941919A (en) | Touch event identification mode | |
| CN202948405U (en) | Optical sensing type keyboard | |
| US20110216014A1 (en) | Multimedia wireless touch control device | |
| CN101702103A (en) | Optical track capturing input device | |
| TW201037579A (en) | Optical input device with multi-touch control | |
| CN101866246A (en) | Multipoint touch type optical input device | |
| TW201239717A (en) | Method for detecting multi-object behavior of a proximity-touch detection device | |
| CN201947347U (en) | Mobile phone for reading with optical finger navigation | |
| CN102467283A (en) | Touch control device with multipoint touch control function and touch control operation method thereof | |
| CN103150058A (en) | Human interface device and application method thereof | |
| CN111078032A (en) | Ring type mouse capable of prejudging merging trend of two fingers and prejudging method | |
| TW201324245A (en) | Human-machine interface device and application method thereof | |
| CN201072534Y (en) | Wireless keyboard with touch panel function | |
| CN203054800U (en) | Anti-interference capacitive touch screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130612 |