CN103076924A - Gesture keyboard application method - Google Patents
Gesture keyboard application method Download PDFInfo
- Publication number
- CN103076924A CN103076924A CN2013100482160A CN201310048216A CN103076924A CN 103076924 A CN103076924 A CN 103076924A CN 2013100482160 A CN2013100482160 A CN 2013100482160A CN 201310048216 A CN201310048216 A CN 201310048216A CN 103076924 A CN103076924 A CN 103076924A
- Authority
- CN
- China
- Prior art keywords
- finger
- keyboard
- fingers
- gesture
- touch pad
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0331—Finger worn pointing device
Abstract
The invention relates to a gesture keyboard application method. A gesture keyboard comprises a touch plate or a finger sleeve, a keyboard, television programs or media or videos, a network and a power supply, wherein the television programs can realize the television card transshipment on the basis of the keyboard, the media are stored in a keyboard storage medium, the videos can be played on network, and the network is connected with a keyboard circuit. The touch plate is independent equipment, can also be a part of the keyboard, generates definition actions for the finger touch of users, and feeds back the actions to the keyboard for operation auxiliary identification, the finger sleeve and the keyboard adopt cabled and/or wireless connection, monitoring and mutual induction (repelling) of micro voltage or electromagnetic and level signals are realized in the finger sleeve, when the fingers are bent or when the fingers simultaneously extend, the definition actions are generated, the actions are fed back to the keyboard for operation auxiliary identification, the keyboard circuit is provided with a corresponding function circuit chip, data processing identification, network connection, television video and telephone application are provided for the keyboard, the keyboard storage media provide carriers for the self software operation system (OS) of the keyboard, and realizes data analysis, supervision and storage, and the power supply provides electricity for the keyboard circuit, the keyboard storage media, the finger sleeve or the touch plate.
Description
Technical field
The present invention relates to a kind of gesture keyboard applications method, particularly can define the function that this action realizes similar mouse.
Background technology
From eighties of last century end of the sixties, the Douglas Engelbart doctor of U.S. Stanford Research Institute has invented mouse.From original mouse, mechanical mouse, optical mouse (optical mouse, laser mouse) by now contact control mouse again, mouse becomes an important instrument of computer input and output.
Although the notebook hardware vendors such as apple, Hewlett-Packard, association have similar touchpad technology, comparatively narrow to the definition that the gesture action recognition is used, still need the application of mouse to improve experience.The application is intended to above-mentioned deficiency, proposes new solution.
Summary of the invention
A kind of gesture keyboard, comprise can gesture identification the touch pad of control, the action command that perhaps cooperatively interacts based on the signal of finger-stall is perhaps based on cursor and the identification of gesture gravity sensing of telepilot design; Keyboard; The television video program of can TV card reprinting based on keyboard, or the media of in the keyboard storage medium, depositing, or video that can netcast; The network that keyboard circuit connects; Power supply;
Touch pad is equipment independently, and the also part of keyboard for the touch of user's finger produces the action of definition, feeds back to the operation aid identification of keyboard;
Finger-stall and keyboard are taked wired, and/or wireless connection, be to have in the finger-stall micro voltage or electromagnetism, the monitoring of level signal, interact (repulsion), when finger during curling or together stretching, extension, produce the action of definition, feed back to the operation aid identification of keyboard;
Keyboard circuit has the circuit chip of corresponding function, for keyboard provides data processing and identification, network connection, television video, phone application;
The keyboard storage medium is that the own software systems (OS) of keyboard provide carrier, is analysis, supervision, the preservation of data; Power supply is keyboard circuit, keyboard storage medium, finger-stall or touch pad power supply.
The gesture keyboard produces the action command of definition by finger-stall or touch pad, and is as follows: drag and drop, dwindle, and amplify, select, copy, shear, deletion, volume increases, and volume is dwindled, left button, right button is confirmed.
The gesture keyboard is finger-stall or touch pad when the definition action, and the coordination of at least 1 to 2 finger is as follows:
Drag and drop: in touch pad, place simultaneously 2 fingers between upper and lower region, finger is mobile from left to right from the top, another finger below keep motionless, form and select cursor to insert between content regions, the chosen content zone is behind the gesture identification confirming operation, the prompting drag and drop, this moment by below another finger up and down interval push-and-pull to releasing section dropping place put, through interval to the dislocation of finger joint that moves right from touch pad, finish drag and drop, another finger also can leave the touch pad interval; When using finger-stall, two fingers merge the selection state for the treatment of, curling motionless when a finger, the another finger moves (separating with another finger) from left to right, forms to select cursor to insert between content regions, the chosen content zone is behind the gesture identification confirming operation, the prompting drag and drop, this moment, by overturning downwards or lifting upwards, push-and-pull to releasing section dropping place was put between curling motionless finger left and right region by a curling finger, through two fingers and and be original state, finish drag and drop;
Dwindle: in touch pad, two fingers slide simultaneously from top to bottom; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from top to bottom;
Amplify: in touch pad, two fingers slide simultaneously from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from bottom to top;
Select: in touch pad, two fingers slide simultaneously from left to right; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from left to right;
Copy: in touch pad, a finger from left to right camber state moves; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers simultaneously from left to right the camber state move;
Shear: in touch pad, a finger moves from right-to-left camber state; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from right-to-left camber state simultaneously;
Deletion: in touch pad, two fingers slide from right-to-left simultaneously; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide from right-to-left simultaneously;
Volume increases: in touch pad, a finger is mobile from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from bottom to top simultaneously;
Volume is dwindled: in touch pad, a finger is mobile from top to bottom; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from top to bottom simultaneously;
Left button: in touch pad, a finger (two fingers) is certainly gone up to left one-tenth arcuation and is moved, and forms left button list (two) and hits; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely left one-tenth arcuation simultaneously;
Right button: in touch pad, a finger (two fingers) is certainly gone up to right one-tenth arcuation and is moved, and forms right button list (two) and hits; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely right one-tenth arcuation simultaneously;
Confirm: in touch pad, two fingers slide in the middle of touch pad from the left and right sides respectively; When using finger-stall, two fingers open, and two fingers merge to the centre from the left and right sides respectively.
The gesture keyboard, touch pad: appearance is two intervals, an interval is the finger touch district, an interval sign auxiliary region that left-right key and pulley are arranged for sign; By intermediate circuit the circuit unit of the senses of touch such as electromagnetism, voltage inductions is captured the interval move mode of corresponding gesture motion, the corresponding instruction of setting up aid identification feeds back to the operation of computer; Perhaps touch pad one side has the micropore diameter camera, captures the interval move mode of corresponding gesture motion by the micropore diameter camera, and the corresponding instruction of setting up aid identification feeds back to the operation of computer; And/or by the finger to the finger Petting Area liquid crystal panel or have the touch pad back printing opacity of light source coverage, stop, cause the induction of the light source (temperature) of finger touch district periphery thermistor spare erratic variation to occur, by the auxiliary chain analysis of close resistance unit as signal source identification, interval move mode to corresponding gesture motion, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
The gesture keyboard, finger-stall is that the electronic tag radio-frequency (RF) identification is that RFID (Radio Frequency IDentification) technology is combined with the camera of micropore diameter imaging technique, the touch that the micropore diameter image-forming assembly captures between the finger produces the action that defines, the spacing of opening and closing between the person's of being combined with two fingers, make the electronic tag radio-frequency (RF) identification, and can set up the corresponding instruction of aid identification according to the demagnetization between two merging, feed back to the operation of keyboard system (and/or computer).
The gesture keyboard, telepilot is parts independently, can be used as the aid of keyboard, comprising: the pros and cons panel; There is the sensor of multiaxis gravity sensing the centre, or the circuit integrated sensor that the multiaxis gravity sensing is arranged; The top can catch from the light field inductor all around of front light bundle the skew that moves up and down of telepilot, and the corresponding instruction of setting up aid identification feeds back to the operation of keyboard system (and/or computer).
The gesture keyboard, telepilot is parts independently, and/or for the electronic tag radio-frequency (RF) identification is the finger-stall that RFID (Radio Frequency IDentification) technology is combined with the micropore diameter imaging technique, can be used as the watch design;
This application has light field inductor, gravity sensor, micropore diameter camera;
By the circuit of built-in electronic battery, can be wirelessly user's gesture motion be connected with keyboard system, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
The gesture keyboard is the keyboard that projectoscope is arranged; Keyboard can be external the voice microphone, projectoscope is that TV card, network (storage medium) video provide corresponding projection video picture, and provides corresponding data-interface for the voice microphone.
Gesture keyboard circuit bus is divided and is connected to chip, can select one of following proposal:
Or microprocessor, data television card;
Or microprocessor, storage chip, display chip, sound audio chip;
Or microprocessor, light transceiving integrated module;
Or microprocessor, printing chip, storage chip, display chip, network chip, sound audio chip;
Or communication radio frequency chip, baseband chip, antenna, sim card slot or integrated SIM card, microprocessor; Perhaps technical application solution includes the selection of above-mentioned technical combinations.
A kind of application process of gesture keyboard, step is as follows:
S1. the exercise of the action model by the user with being familiar with of definition gesture motion, is connected user's gesture motion with keyboard system, set up the corresponding instruction of aid identification, feeds back to the operation of computer and/or intelligent keyboard system;
S2. the software that passes through gesture keyboard and aid identification instrument (such as telepilot, finger-stall, watch, touch pad) is to the behavioural analysis of user's gesture motion, and the efficient of using strengthened in error correction, prompting, record;
S3. the process of using to the usage behavior analysis, gives Complied executing for meeting the software that uses gesture identification to use, and increases the scope that gesture identification is used;
S4. by the feedback to the user, on the principle of above-mentioned technology, strengthen the improvement of existing Gesture Recognition hardware;
S5. finish.
Inventor's imagination: change the dependence of above-mentioned mouse applications technology, make Gesture Recognition substitute existing mouse similar functions, make keyboard system have independently operability, can become unique main frame of following IT computer and the instrument of identification input and output.
Description of drawings
Fig. 1 is touch pad gesture motion synoptic diagram of the present invention,
Fig. 2 is touch pad floor map of the present invention,
Fig. 3 is finger-stall structural representation of the present invention,
Fig. 4 is remote controller structure synoptic diagram of the present invention,
Fig. 5 is telepilot front schematic view of the present invention,
Fig. 6 is watch structural representation of the present invention,
Fig. 7 is circuit structure diagram of the present invention,
Fig. 8 is method step figure of the present invention.
Embodiment
A kind of gesture keyboard, comprise can gesture identification the touch pad 13 of control, the action command that perhaps cooperatively interacts based on the signal of finger-stall 17 is perhaps based on cursor and the identification of gesture gravity sensing of telepilot 20 designs; Keyboard; Based on keyboard can TV card the 28 television video programs of reprinting, or media of in the keyboard storage medium, depositing, or video that can netcast; The network that keyboard circuit connects; Power supply;
Touch pad 13 is equipment independently, and the also part of keyboard for the touch of user's finger produces the action of definition, feeds back to the operation aid identification of keyboard;
Finger-stall 17 is taked wired with keyboard, and/or wireless connection, be to have in the finger-stall micro voltage or electromagnetism, the monitoring of level signal, interact (repulsion), when finger during curling or together stretching, extension, produce the action of definition, feed back to the operation aid identification of keyboard;
Keyboard circuit has circuit 23 chips of corresponding function, for keyboard provides data processing and identification, network connection, television video, phone application;
The keyboard storage medium is that the own software systems (OS) of keyboard provide carrier, is analysis, supervision, the preservation of data; Power supply is keyboard circuit, keyboard storage medium, finger-stall 17 or touch pad 13 power supplies.
With reference to Fig. 1, the gesture keyboard produces the action command of definition by finger-stall or touch pad, and is as follows: drag and drop 1, dwindle 2, and amplify 3, select 4, copy 5, shear 6, deletion 7, volume increases 8, and volume dwindles 9, left button 10, right button 11 confirms 12.About drag and drop among Fig. 11, have in the bottom up and down that the arrow diagramming of interval selection should be the dotted line sign, there is any discrepancy because of imaging effect, takes this as the standard.
The gesture keyboard is finger-stall or touch pad when the definition action, and the coordination of at least 1 to 2 finger is as follows:
Drag and drop 1: in touch pad 13, place simultaneously 2 fingers between upper and lower region, finger is mobile from left to right from the top, another finger below keep motionless, form and select cursor to insert between content regions, the chosen content zone is behind the gesture identification confirming operation, the prompting drag and drop, this moment by below another finger up and down interval push-and-pull to releasing section dropping place put, through interval to the dislocation of finger joint that moves right from touch pad, finish drag and drop, another finger also can leave the touch pad interval; When using finger-stall 17, two fingers merge the selection state for the treatment of, when a finger curling motionless, the another finger moves (separating with another finger) from left to right, form and select cursor to insert between content regions, drag and drop are pointed out in the chosen content zone behind the gesture identification confirming operation, made progress by overturn downwards or lift by a curling finger this moment, push-and-pull to releasing section dropping place is put between curling motionless finger left and right region, through two fingers and and be original state, finish drag and drop, treat that two fingers are crooked, are release;
Dwindle 2: in touch pad 13, two fingers slide simultaneously from top to bottom; When using finger-stall 17, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from top to bottom, treat that two fingers are crooked, are release;
Amplify 3: in touch pad, two fingers slide simultaneously from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from bottom to top, treat that two fingers are crooked, are release;
Select 4: in touch pad, two fingers slide simultaneously from left to right; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from left to right, treat that two fingers are crooked, are release;
Copy 5: in touch pad, a finger from left to right camber state moves; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers simultaneously from left to right the camber state move, treat that two fingers are crooked, are release;
Shear 6: in touch pad, a finger moves from right-to-left camber state; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from right-to-left camber state simultaneously, treat that two fingers are crooked, are release;
Deletion 7: in touch pad, two fingers slide from right-to-left simultaneously; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide from right-to-left simultaneously, treat that two fingers are crooked, are release;
Volume increases 8: in touch pad, a finger is mobile from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from bottom to top simultaneously, treat that two fingers are crooked, are release;
Volume dwindles 9: in touch pad, a finger is mobile from top to bottom; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from top to bottom simultaneously, treat that two fingers are crooked, are release;
Left button 10: in touch pad, a finger (two fingers) is certainly gone up to left one-tenth arcuation and is moved, and forms left button list (two) and hits; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely left one-tenth arcuation simultaneously, treat that two fingers are crooked, are release;
Right button 11: in touch pad, a finger (two fingers) is certainly gone up to right one-tenth arcuation and is moved, and forms right button list (two) and hits; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely right one-tenth arcuation simultaneously, treat that two fingers are crooked, are release;
Confirm 12: in touch pad, two fingers slide in the middle of touch pad from the left and right sides respectively; When using finger-stall, two fingers open, and two fingers merge to the centre from the left and right sides respectively, treat that two fingers are crooked, are release.
Such scheme is to be instruction pre-service state when finger contact arrives touch pad 13; When the finger in the touch pad all breaks away from touch pad, be release; When using finger-stall 17, two fingers are merged into action command and are treated the selection state, and two fingers are bent into action command to be finished.
With reference to Fig. 2, touch pad 13: appearance is two intervals, and an interval is finger touch district 14, the one interval sign auxiliary regions 15 that left-right key and pulley 16 are arranged for sign; Capture the interval move mode of corresponding gesture motion by circuit 23 assemblies of the senses of touch such as 23 pairs of electromagnetism of intermediate circuit, voltage inductions, the corresponding instruction of setting up aid identification feeds back to the operation of computer; Perhaps touch pad 13 peripheral sides have micropore diameter camera 19, capture the interval move mode of corresponding gesture motion by micropore diameter camera 19, and the corresponding instruction of setting up aid identification feeds back to the operation of keyboard system (and/or computer).This figure is the example of touch pad and keyboard integrated.This micropore camera 19 is camera similarly also, and when adopting camera to the scheme of corresponding gesture motion discriminatory analysis, intermediate circuit 23 does not need the circuit unit design to the induction of the senses of touch such as electromagnetism, voltage; Perhaps this touch pad can be taked that above-mentioned multiple technologies are used and/or select.
Have left-right key can to about cursor gives between the page pool to auxiliary control; Pulley 16 can facilitate for push-and-pull about the visible page; Sign has button or the pulley of sign auxiliary region 15 of left-right key and pulley 16, can be circuit 23 component design of the sense of touch inductions such as the electromagnetism of touch sensible, voltage; Also can be left-right key and the pulley design of entity; Perhaps micropore diameter camera 19 captures the finger interval range, to the scheme of corresponding gesture motion discriminatory analysis.
Perhaps in theory can also be with micropore diameter camera 19, resistance unit 21 with similar temperature-sensitive gradual change induction is replaced, by the finger to the finger Petting Area 14 liquid crystal panels or have the touch pad 13 back printing opacities of light source coverage, stop, cause the induction of the light source (temperature) of finger touch district 13 peripheral thermistor spares erratic variation to occur, by the auxiliary chain analysis of close resistance unit 21 as signal source identification, interval move mode to corresponding gesture motion, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
In this case, because of the induction of 21 pairs of light sources of peripheral thermistor spare, in the situation that does not have finger to stop or block, following possibility is arranged: the thermal sensing value of each peripheral thermistor spare is identical; Or peripheral thermistor spare has certain difference because of the distance of back side printing opacity light source distance; Finger stop or the situation of blocking under, certain peripheral thermistor spare 21 relative photoinduction (thermal sensing value) has strong and weak differentiation, peripheral thermistor spare in simultaneously can the auxiliary induction value changing, to finger stop or the situation of blocking under, i.e. motion track analysis and the conclusion of finger, instruction to after the corresponding gesture motion discriminating realizes feeding back to the operation of keyboard system (and/or computer).
Even touch pad 13 can be also with the virtual key (physical button) that shows above-mentioned action, replace the process of gesture identification action, reach similar technique effect.At this, the creative scheme of similar this nonindependence should not be considered as comprehensive covering principle of present technique or the skew of doctrine of equivalents.
With reference to Fig. 3, finger-stall 17 is camera 19 combinations of electronic tag 18 radio frequency discrimination RFIDs (Radio Frequency IDentification) technology and micropore diameter imaging technique, the touch that the micropore diameter image-forming assembly captures between the finger produces the action that defines, the spacing of opening and closing between the person's of being combined with two fingers, make the electronic tag radio-frequency (RF) identification, and can set up the corresponding instruction of aid identification according to the demagnetization between two merging, feed back to the operation of keyboard system (and/or computer).
The outward appearance of finger-stall is the flexible material making such as rubber, by built-in microcircuit integrated electronic label and micropore diameter image-forming assembly, by the micropore diameter imaging to gesture action behavior record, by mutually identification coupling between electronic tag, and the signal wireless mode can be sent to the keyboard system processing, the built-in electronic powered battery is arranged; Perhaps finger-stall is the power supply of finger-stall interlock circuit by wired mode connecting key disc system by keyboard system.
With reference to Fig. 4, telepilot 20 is parts independently, can be used as the aid of keyboard, comprising: the pros and cons panel; There is the sensor 22 of multiaxis gravity sensing the centre, or circuit 23 is integrated with the sensor 22 of multiaxis gravity sensing; The top can catch from the light field inductor all around 24 of front light bundle the skew that moves up and down of telepilots, and the corresponding instruction of setting up aid identification feeds back to the operation of keyboard system (and/or computer).
In like manner, combination technique between the sensor 22 of thermistor spare 21 and multiaxis gravity sensing, strong and weak differentiation also can be arranged according to the photoinduction (thermal sensing value) of projecting beam, such as the light source from the place ahead, the perhaps own light source of telepilot own, thermistor spare forms photoinduction (thermal sensing value) numerical value in similar chessboard interval to grating, by photoinduction (thermal sensing value) numerical value is contrasted, sensor 22 horizontal stationary original states in conjunction with the multiaxis gravity sensing, the rollover state, the translation state, vertical state, downward-sloping state, action command is preset in definition, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
Further with regard to the numerical value comparative illustration between the thermistor spare 21, suppose around telepilot 20 tops, transversely (descend) respectively to have thermistor spare 21A (... 21N), vertical left (right side) respectively have thermistor spare 21a (... 21n), 21A and 21a form between an induction zone, when application change appears in the sensor 22 horizontal stationary original states of telepilot 20 multiaxis gravity sensings, photoinduction (thermal sensing value) the numerical value difference that causes moment between each induction zone so just forms the judgement that the gesture motion behavior changes.
The panel of Fig. 4 telepilot 20 can be considered the diagram of back panel.
With reference to Fig. 5, telepilot 20 front panels are that key mode is indicated gesture identification instruction (diagram or corresponding literal), and the light beam of projectoscope 26 is arranged, and preferably infrared light beam projection can be used in the environment of high light;
Perhaps the telepilot back panel is touch pad 13 designs.
About drag and drop among Fig. 51, have in the bottom up and down that the arrow diagramming of interval selection should be the dotted line sign, there is any discrepancy because of imaging effect, takes this as the standard.
With reference to Fig. 6, telepilot 20 is parts independently, and/or for electronic tag 18 radio-frequency (RF) identification are the finger-stall 17 that RFID (Radio Frequency IDentification) technology is combined with the micropore diameter imaging technique, can be used as watch 25 and design;
This application has light field inductor 24, gravity sensor 22, micropore diameter camera 19;
By the circuit 23 of built-in electronic battery, can be wirelessly user's gesture motion be connected with keyboard system, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
Comprehensive above-mentioned case, the gesture motion of watch 25 design can be between the sensor 22 of thermistor spare 21 and multiaxis gravity sensing combination technique, or the combination technique between the sensor 22 of micropore diameter camera 19 and multiaxis gravity sensing, the skew that moves up and down of light field inductor 24 seizure telepilots etc. has been stated and has been selected suitable application in the scheme, and can be for the translation of wrist portion and/or ancon, bently the action such as open up, hold up, put down, define similar instruction, feed back to the operation of keyboard system (and/or computer).
The gesture keyboard is the keyboard that projectoscope 26 is arranged; Keyboard can be external the voice microphone, projectoscope is that TV card, network (storage medium) video provide corresponding projection video picture, and provides corresponding data-interface for the voice microphone.
With reference to Fig. 7, gesture keyboard circuit 23 buses are divided and are connected to chip, can select one of following proposal:
Or microprocessor 27, data television card 28; This scheme is to realize unidirectional data identification by the reception of network to TV data;
Or microprocessor 27, storage chip 29, display chip 30, sound audio chip 31; This scheme is to satisfy basic computer applications; Under the different application condition, sound audio chip 31 can be used as independently circuit-line design;
Or microprocessor 27, light transceiving integrated module 32; This scheme is the connection of optical communication network, and data transmission that can be two-way exchanges, and key is the application of network environment;
Or microprocessor 27, printing chip 33, storage chip 29, display chip 30, network chip 34, sound audio chip 31; This scheme is the application of own working environment, can select certain internetwork connection mode;
Or communication radio frequency chip 35, baseband chip 36, antenna 37, sim card slot or integrated SIM card 38, microprocessor 27; This scheme is the application of wireless network.
Perhaps technical application solution includes the selection of above-mentioned technical combinations.
The communication radio frequency chip 35 of circuit, baseband chip 36 selected the chip of applicable following communication standard: described communication standard be TD-SCDMA, TD-SCDMA to HSPA, TD MBMS to TDD LTE, WCDMA, HSDPA, CDMA20001 * EV-D0, UMB, UWB, Wimax802.16d e m, LTE under SAE, Wapi, the compatible Wlan Wifi802.11b g n aq, Mimo ofdm, IGRS's technology, bluetooth or McWiLL chip;
Circuit is 400mhz, 450～470mhz, 698mhz～806mhz, 900mhz, 1110mhz, 1800mhz, 1900mhz, 2100mhz, 2300～2400mhz, 2 by antenna guide work radio band, 500～2,690mHz, 3300mhz, 3400～3600mhz, 3650-3700MHz frequency range; Realize that wireless network connects and the function of communication telephones;
Light transceiving integrated module 32 choosing wavelengths of circuit are interval:
At 850nm, 1310nm, 1490nm, 1550nm, CWDM, DWDM realizes the exchanges data under the optical communication environment, and can be by data and the light exchanges data of cable network or wireless network.
This cable data or wireless data are changed mutually, or cable data is the conversion of optical communication data, or wireless data is walking around of optical communication data, is not only in order to solve the intercommunication between data, also to be and can to use service support for other equipment provide network in applicable network.
The Technology Integration of above-mentioned communication radio frequency chip, baseband chip standard module, single chip design may prior art are used may.Perhaps, the integration of communication module and light transceiving integrated module, the perhaps Technology Integration of optical transceiver module and radio frequency chip, baseband chip standard module, the improvement of optical transceiver module and IC induction chip or microprocessor Technology Integration, the component chip Function Integration Mechanism occurs and cause the key element of non-innovation to be omitted, should not be considered as the conflict to complete comprehensive covering principle of the present invention.
Microprocessor is applicable to RISC framework, MIPS framework, ARM or x86 framework, quantum or the photon CPU choice of technology of following DSP, CPU or GPU, APU.Technological incorporation appears in the technical development of making a general survey of microprocessor 13:
1, Intel plans the WiFi function is built among the semi-conductor chip, and particularly the developing direction of South Bridge chip mainly is integrated more function, such as network interface card, RAID, IEEE 1394 even WI-FI wireless network etc., and IT merges with communication chip and designs.
2, optical communication chip, the invention of Graphene chip make network Development hardware unknown mutation occur, and the progress of technology is the reference of selection standard.
But for changing bad invention, perhaps cost is considered, and perhaps bad manufacturer evades patent and covers principle comprehensively, only from the selection of technical scheme of practicality.
Keyboard has special purpose interface, is not limited to one of lower interface: USB interface, IEEE1394 interface, parallel interface, pc card slot interface, card reader interface, serial line interface, Micro SATA interface, pcmcia interface, PS/2 interface, TV-OUT interface, TV-Tuner interface, S-VIDEO interface, MODEM interface, network interface card interface, Station interface, Kensington interface.
With reference to Fig. 8, a kind of application process of gesture keyboard, step is as follows:
S1. the exercise of the action model by the user with being familiar with of definition gesture motion, is connected user's gesture motion with keyboard system, set up the corresponding instruction of aid identification, feeds back to the operation of computer and/or intelligent keyboard system;
S2. the software that passes through gesture keyboard and aid identification instrument (such as telepilot, finger-stall, watch, touch pad) is to the behavioural analysis of user's gesture motion, and the efficient of using strengthened in error correction, prompting, record;
S3. the process of using to the usage behavior analysis, gives Complied executing for meeting the software that uses gesture identification to use, and increases the scope that gesture identification is used;
S4. by the feedback to the user, on the principle of above-mentioned technology, strengthen the improvement of existing Gesture Recognition hardware;
S5. finish.
Claims (10)
1. gesture keyboard, comprise can gesture identification control touch pad, the action command that perhaps cooperatively interacts based on the signal of finger-stall is perhaps based on cursor and the identification of gesture gravity sensing of telepilot design; Keyboard; The television video program of can TV card reprinting based on keyboard, or the media of in the keyboard storage medium, depositing, or video that can netcast; The network that keyboard circuit connects; Power supply;
Touch pad is equipment independently, and the also part of keyboard for the touch of user's finger produces the action of definition, feeds back to the operation aid identification of keyboard;
Finger-stall and keyboard are taked wired, and/or wireless connection, be to have in the finger-stall micro voltage or electromagnetism, the monitoring of level signal, interact (repulsion), when finger during curling or together stretching, extension, produce the action of definition, feed back to the operation aid identification of keyboard;
Keyboard circuit has the circuit chip of corresponding function, for keyboard provides data processing and identification, network connection, television video, phone application;
The keyboard storage medium is that the own software systems (OS) of keyboard provide carrier, is analysis, supervision, the preservation of data; Power supply is keyboard circuit, keyboard storage medium, finger-stall or touch pad power supply.
2. gesture keyboard according to claim 1 is characterized in that finger-stall or touch pad produce the action command of definition, and is as follows: drag and drop (1), dwindle (2), amplify (3), select (4), copy (5), shear (6), deletion (7), volume increases (8), volume is dwindled (9), left button (10), right button (11) is confirmed (12).
3. gesture keyboard according to claim 1 is characterized in that finger-stall or touch pad when the definition action, and the coordination of at least 1 to 2 finger is as follows:
Drag and drop (1): in touch pad (13), place simultaneously between upper and lower region 1 and/or 2 and point the selection state for the treatment of, a finger is mobile from left to right from the top, another finger below keep motionless, form and select cursor to insert between content regions, the chosen content zone is behind the gesture identification confirming operation, the prompting drag and drop, this moment by below another the finger up and down interval push-and-pull to releasing section dropping place put, through interval to the dislocation of finger joint that moves right from touch pad, finish drag and drop, another finger also can leave the touch pad interval; When using finger-stall, two fingers merge the selection state for the treatment of, curling motionless when a finger, the another finger moves (separating with another finger) from left to right, forms to select cursor to insert between content regions, the chosen content zone is behind the gesture identification confirming operation, the prompting drag and drop, this moment, by overturning downwards or lifting upwards, push-and-pull to releasing section dropping place was put between curling motionless finger left and right region by a curling finger, through two fingers and and be original state, finish drag and drop;
Dwindle (2): in touch pad, two fingers slide simultaneously from top to bottom; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from top to bottom;
Amplify (3): in touch pad, two fingers slide simultaneously from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from bottom to top;
Select (4): in touch pad, two fingers slide simultaneously from left to right; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide simultaneously from left to right;
Copy (5): in touch pad, a finger from left to right camber state moves; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers simultaneously from left to right the camber state move;
Shear (6): in touch pad, a finger moves from right-to-left camber state; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from right-to-left camber state simultaneously;
Deletion (7): in touch pad, two fingers slide from right-to-left simultaneously; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers slide from right-to-left simultaneously;
Volume increases (8): in touch pad, a finger is mobile from bottom to top; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from bottom to top simultaneously;
Volume is dwindled (9): in touch pad, a finger is mobile from top to bottom; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers are mobile from top to bottom simultaneously;
Left button (10): in touch pad, a finger (two fingers) is certainly gone up to left one-tenth arcuation and is moved, and forms left button list (two) and hits; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely left one-tenth arcuation simultaneously;
Right button (11): in touch pad, a finger moves from upper extremely right one-tenth arcuation; When using finger-stall, two fingers merge the selection state for the treatment of, two fingers move from upper extremely right one-tenth arcuation simultaneously;
Confirm (12): in touch pad, two fingers slide in the middle of touch pad from the left and right sides respectively; When using finger-stall, two fingers open, and two fingers merge to the centre from the left and right sides respectively.
4. gesture keyboard according to claim 1, it is characterized in that touch pad (13): appearance is two intervals, one interval is finger touch district (14), an interval sign auxiliary region (15) that left-right key and pulley (16) are arranged for sign; By intermediate circuit (23) circuit unit of the senses of touch such as electromagnetism, voltage inductions is captured the interval move mode of corresponding gesture motion, the corresponding instruction of setting up aid identification feeds back to the operation of computer; And/or touch pad (13) one sides have micropore diameter camera (19), capture the interval move mode of corresponding gesture motion by micropore diameter camera (19), and the corresponding instruction of setting up aid identification feeds back to the operation of computer; And/or by the finger to the finger Petting Area (14) liquid crystal panel or have touch pad (13) the back printing opacity of light source coverage, stop, cause the induction of the light source (temperature) of the peripheral thermistor spare in finger touch district (13) (21) erratic variation to occur, by the auxiliary chain analysis of close resistance unit as signal source identification, interval move mode to corresponding gesture motion, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
5. gesture keyboard according to claim 1, it is characterized in that finger-stall (17) is camera (19) combination of RFID (Radio Frequency IDentification) technology and micropore diameter imaging technique for electronic tag (18) radio-frequency (RF) identification, the touch that the micropore diameter image-forming assembly captures between the finger produces the action that defines, the spacing of opening and closing between the person's of being combined with two fingers, make the electronic tag radio-frequency (RF) identification, and can be according to the demagnetization between two merging, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
6. gesture keyboard according to claim 1 is characterized in that telepilot (20) is parts independently, can be used as the aid of keyboard, comprising: the pros and cons panel; There is the sensor (22) of multiaxis gravity sensing the centre, or circuit (23) is integrated with the sensor of multiaxis gravity sensing; The top can catch from the light field inductor (24) all around of front light bundle the skew that moves up and down of telepilot, and the corresponding instruction of setting up aid identification feeds back to the operation of computer; Or telepilot (20) pros and cons panel has the text prompt of symbol or the command adapted thereto of similar gesture motion.
7. according to claim 5 or 6 described gesture keyboards, it is characterized in that telepilot (20) is parts independently, and/or for electronic tag (18) radio-frequency (RF) identification is the finger-stall (17) that RFID (Radio Frequency IDentification) technology is combined with the micropore diameter imaging technique, can be used as watch (25) design;
This application has light field inductor (24), gravity sensor (22), micropore diameter camera (19);
By the circuit of built-in electronic battery, can be wirelessly user's gesture motion be connected with keyboard system, set up the corresponding instruction of aid identification, feed back to the operation of keyboard system (and/or computer).
8. gesture keyboard according to claim 7, it is characterized in that projectoscope the is arranged keyboard of (26); Keyboard can be external the voice microphone, projectoscope (26) is that TV card, network (storage medium) video provide corresponding projection video picture, and provides corresponding data-interface for the voice microphone.
9. gesture keyboard according to claim 1 is characterized in that the circuit bus is divided to be connected to chip, can select one of following proposal:
Or microprocessor (27), data television card (28);
Or microprocessor (27), storage chip (29), display chip (30), sound audio chip (31);
Or microprocessor (27), light transceiving integrated module (32);
Or microprocessor (27), printing chip (33), storage chip (29), display chip (30), network chip (34), sound audio chip (31);
Or communication radio frequency chip (35), baseband chip (36), antenna (37), sim card slot or integrated SIM card (38), microprocessor (27); Perhaps technical application solution includes the selection of above-mentioned technical combinations.
10. the application process of a gesture keyboard, step is as follows:
S1. the exercise of the action model by the user with being familiar with of definition gesture motion, is connected user's gesture motion with keyboard system, set up the corresponding instruction of aid identification, feeds back to the operation of computer and/or intelligent keyboard system;
S2. the software that passes through gesture keyboard and aid identification instrument (such as telepilot, finger-stall, watch, touch pad) is to the behavioural analysis of user's gesture motion, and the efficient of using strengthened in error correction, prompting, record;
S3. the process of using to the usage behavior analysis, gives Complied executing for meeting the software that uses gesture identification to use, and increases the scope that gesture identification is used;
S4. by the feedback to the user, on the principle of above-mentioned technology, strengthen the improvement of existing Gesture Recognition hardware;
S5. finish.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310048216.0A CN103076924B (en) | 2013-02-06 | 2013-02-06 | Gesture keyboard application method |
| PCT/CN2014/071863 WO2014121746A1 (en) | 2013-02-06 | 2014-02-05 | Gesture keyboard application method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310048216.0A CN103076924B (en) | 2013-02-06 | 2013-02-06 | Gesture keyboard application method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103076924A true CN103076924A (en) | 2013-05-01 |
| CN103076924B CN103076924B (en) | 2014-08-13 |
Family
ID=48153472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310048216.0A Active CN103076924B (en) | 2013-02-06 | 2013-02-06 | Gesture keyboard application method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103076924B (en) |
| WO (1) | WO2014121746A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014121746A1 (en) * | 2013-02-06 | 2014-08-14 | Fang Kefeng | Gesture keyboard application method |
| CN105788228A (en) * | 2014-12-23 | 2016-07-20 | 中兴通讯股份有限公司 | Method and system of wearable device control terminal, the terminal and wearable device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1262750A (en) * | 1998-03-12 | 2000-08-09 | 皇家菲利浦电子有限公司 | Multiple pressure sensors by using per finger of glove for virtual full typing |
| US20070152978A1 (en) * | 2006-01-05 | 2007-07-05 | Kenneth Kocienda | Keyboards for Portable Electronic Devices |
| CN201072529Y (en) * | 2007-06-22 | 2008-06-11 | 王宝根 | Finger keyboard and mouse integration system and computer integrated operation chair formed by the same |
| US20100100854A1 (en) * | 2008-10-16 | 2010-04-22 | Dell Products L.P. | Gesture operation input system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101206533A (en) * | 2006-12-18 | 2008-06-25 | 汉王科技股份有限公司 | Mouse with mobile memory function and hand-written input function |
| CN101697096A (en) * | 2009-10-30 | 2010-04-21 | 清华大学 | Wireless input terminal worn on fingers |
| CN201654683U (en) * | 2010-02-12 | 2010-11-24 | 精模电子科技（深圳）有限公司 | Keyboard with multipoint touch function |
| CN103076924B (en) * | 2013-02-06 | 2014-08-13 | 东莞市傲思电子科技有限公司 | Gesture keyboard application method |
-
2013
- 2013-02-06 CN CN201310048216.0A patent/CN103076924B/en active Active
-
2014
- 2014-02-05 WO PCT/CN2014/071863 patent/WO2014121746A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1262750A (en) * | 1998-03-12 | 2000-08-09 | 皇家菲利浦电子有限公司 | Multiple pressure sensors by using per finger of glove for virtual full typing |
| US20070152978A1 (en) * | 2006-01-05 | 2007-07-05 | Kenneth Kocienda | Keyboards for Portable Electronic Devices |
| CN201072529Y (en) * | 2007-06-22 | 2008-06-11 | 王宝根 | Finger keyboard and mouse integration system and computer integrated operation chair formed by the same |
| US20100100854A1 (en) * | 2008-10-16 | 2010-04-22 | Dell Products L.P. | Gesture operation input system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014121746A1 (en) * | 2013-02-06 | 2014-08-14 | Fang Kefeng | Gesture keyboard application method |
| CN105788228A (en) * | 2014-12-23 | 2016-07-20 | 中兴通讯股份有限公司 | Method and system of wearable device control terminal, the terminal and wearable device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014121746A1 (en) | 2014-08-14 |
| CN103076924B (en) | 2014-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8212774B2 (en) | Collapsible wireless input device | |
| JP5931298B2 (en) | Virtual keyboard display method, apparatus, terminal, program, and recording medium | |
| US20180217679A1 (en) | Mobile terminal and mobile terminal control method | |
| CN103813192B (en) | The method, apparatus and computer program product of switching TV channel | |
| CN102902476B (en) | A kind of method of touch terminal control electronic equipment and system thereof | |
| CN103475754A (en) | Personal information exchange device and method based on smart watch | |
| CN103246353B (en) | Keyboard and keyboard box combination device and application method | |
| CN106462313A (en) | Method and electronic device for managing display objects | |
| CN103442104A (en) | Mobile terminal and display control method thereof | |
| CN102667701A (en) | Method of modifying commands on a touch screen user interface | |
| CN103995667A (en) | Terminal and terminal screen unlocking method | |
| CN102902406B (en) | The system of a kind of touch terminal and control electronic equipment thereof | |
| CN104102484A (en) | APP operating method and device and app output device supporting the same | |
| CN108605374A (en) | Show the method that equipment and setting show the working channel of equipment | |
| CN102736906A (en) | Method for implementing switching and management of multiple operating interfaces on personal terminal | |
| CN103419729A (en) | Method for controlling vehicle parts | |
| CN107249071A (en) | A kind of method that Intelligent worn device controls mobile terminal | |
| CN103076924B (en) | Gesture keyboard application method | |
| CN105824399A (en) | Control method, system and apparatus for projection equipment | |
| CN104331159A (en) | Intelligent hand wearing type equipment and control system | |
| CN107179840A (en) | Controller and its control method | |
| CN103157282A (en) | Method of conducting touch game and relevant entertainment system | |
| TWI567535B (en) | Techniques for solar cell management for computing devices | |
| CN107679382A (en) | The control method and controller of a kind of reader | |
| CN102707835B (en) | A kind of handheld terminal, interactive system and exchange method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: DONGGUAN AOSI ELECTRIC TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: FANG KEFENG Effective date: 20140717 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20140717 Address after: Xu thousand room 406~408 Building No. 27 Dongcheng District Avenue 523000 in Guangdong city of Dongguan Province Applicant after: FANG KEFENG Address before: 523000 Guangdong province Dongguan City Wanjiang victory community Longwan Nga Court 2 A5 Applicant before: Fang Kefeng |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |