CN1809866A - Systems to enhance data entry in mobile and fixed environment - Google Patents
Systems to enhance data entry in mobile and fixed environment Download PDFInfo
- Publication number
- CN1809866A CN1809866A CN 200480017215 CN200480017215A CN1809866A CN 1809866 A CN1809866 A CN 1809866A CN 200480017215 CN200480017215 CN 200480017215 CN 200480017215 A CN200480017215 A CN 200480017215A CN 1809866 A CN1809866 A CN 1809866A
- Authority
- CN
- China
- Prior art keywords
- word
- button
- user
- keypad
- character
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Input From Keyboards Or The Like (AREA)
Abstract
The present invention provides a data input system having a keypad defining a plurality of keys, each key contains at least one symbol of a group of symbols. The group of symbols is divided into subgroups each having at least one of alphabetical symbols, numeric symbols, and command symbols, where each subgroup is associated with at least a portion of a user's finger. A finger recognition system is in communication with at least one key, where the key has at least a first symbol from a first subgroup and at least a second symbol from a second subgroup, The finger recognition system is configured to recognize the portion of the user's finger when the finger interacts with the key so as to select the symbol on the key, corresponding to the subgroup associated with the portion of the user's finger.
Description
Related application
The application requires following U.S. Provisional Application No., Nos.60/463, and 844, the applying date is on April 18th, 2003; 60/466,594, the applying date is on April 30th, 2003; 60/468,028, the applying date is on May 5th, 2003; 60/474,447, the applying date is on May 30th, 2003; 60/475,533, the applying date is on June 3rd, 2003; 60/482,706, the applying date is on June 26th, 2003; 60/482,998, the applying date is on June 27th, 2003; 60/496,702, the applying date is on August 20th, 2003; 60/500,602, the applying date is on September 5th, 2003; 60/504,331, the applying date is on September 19th, 2003; 60/510,885, the applying date is on October 14th, 2003; 60/536,564, the applying date is on January 14th, 2004; 60/552,968, the applying date is on March 11st, 2004; 60/557,140, the applying date is on March 26th, 2004, and more than application all is incorporated in incorporated by reference here.
Technical field
The application relates to the system and method that is used for input character.More particularly, the application relates to the system and method that is used to use button, sound or their combinatorial input character.
Background technology
Be used for the use that the exemplary systems of input character electronically and method comprise the QWERTY keyboard of qwerty keyboard for example or analog.But, because modern electronic equipment has become littler, so in order to import required character, new method is developed.
One of this method be on standard telephone type numeric keypad, use repeatedly-press system, thus a plurality of alphabetic characters are distributed to identical button.The shortcoming that this system had is, in order to import definite character, need repeatedly press single button, has therefore increased the total degree that button is pressed, and makes the character input process slow.
Be used on usually littler equipment, providing the second method of character input to have on equipment, make simply the miniaturization of standard QWERTY keypad.But, the keypad of this miniaturization often has not much shape and sees, and does not provide enough spaces between button, when only needing single to press, causes a plurality of buttons to be pressed.
The another kind of trial that provides character to import on littler electronic equipment is the use of voice recognition software.This method has been used a period of time, but has a plurality of shortcomings.The most significant is that voice recognition software can not be distinguished homonym, and often needs important input in early stage, is used for system special speaker, its mannerism and voice custom are discerned.Equally, when attempting alleviating these problems, it is very big that voice recognition software has become, and need a large amount of processing, is not to be particularly suitable for for example limited power supply and the processing power of the miniaturized electronics of mobile phone and text type pager.
Summary of the invention
The objective of the invention is to overcome the shortcoming relevant with prior art, and a kind of system and method that is used for input character is provided, it fast, does not reliably need the expense of a large amount of assemblings and energy/processing.
For this reason, the present invention is directed to the data entry system that has by a plurality of keypads by key definition, and here, each button comprises at least one symbol of glossary of symbols.Glossary of symbols is divided into the child group with at least one alphabet symbol, numeric character and order symbol, and here, each son group is associated with at least a portion of user's finger.
At least one button that the finger recognition system is provided as with a plurality of buttons communicates, here, at least one button has first symbol of organizing from first son at least, and second symbol organizing from second son at least, here, the finger recognition system is configured to when finger and button when mutual, and the part of user's finger is discerned, thereby on button, symbol is selected corresponding to the child group that is associated with the part of user's finger.
Description of drawings
Fig. 1 shows keypad according to an embodiment of the invention;
Fig. 2 shows keypad according to an embodiment of the invention;
Fig. 3 shows the keypad with display according to an embodiment of the invention;
Fig. 4 shows keypad according to an embodiment of the invention;
Fig. 5 shows keypad according to an embodiment of the invention;
Fig. 6 shows the keypad with display according to an embodiment of the invention;
Fig. 7 shows the keypad with display according to an embodiment of the invention;
Fig. 7 a shows the process flow diagram that is used to proofread and correct according to an embodiment of the invention;
Fig. 8 shows folding keypad according to an embodiment of the invention;
Fig. 9 shows folding keypad according to an embodiment of the invention;
Figure 10 shows folding keypad according to an embodiment of the invention;
Figure 11 shows folding keypad according to an embodiment of the invention;
Figure 12 shows folding keypad according to an embodiment of the invention;
Figure 13 shows the keypad with display according to an embodiment of the invention;
Figure 14 shows the keypad with display according to an embodiment of the invention;
Figure 15 shows the keypad with mouse according to an embodiment of the invention;
Figure 16 shows the keypad with mouse according to an embodiment of the invention;
Figure 17 shows a plurality of equipment of use keypad according to an embodiment of the invention;
Figure 18 shows the keypad with microphone according to an embodiment of the invention;
Figure 18 B shows the keypad with microphone according to an embodiment of the invention;
Figure 18 C shows the keypad with microphone according to an embodiment of the invention;
Figure 18 D shows the keypad with microphone according to an embodiment of the invention;
Figure 18 E shows the keypad with antenna according to an embodiment of the invention;
Figure 18 F shows the keypad with antenna according to an embodiment of the invention;
Figure 18 G shows the keypad with microphone according to an embodiment of the invention;
Figure 18 H shows the keypad with microphone according to an embodiment of the invention;
Figure 18 I shows the keypad with microphone according to an embodiment of the invention;
Figure 19 shows the keypad with display and PC according to an embodiment of the invention;
Figure 20 shows the keypad with display and PC according to an embodiment of the invention;
Figure 21 shows the keypad with display and laptop computer according to an embodiment of the invention;
Figure 22 shows the keypad with display and indicator screen according to an embodiment of the invention;
Figure 22 a shows the keypad with folding display according to an embodiment of the invention;
Figure 22 b shows the keypad on the wrist and the display of remote control of being worn over according to an embodiment of the invention;
Figure 23 a shows keypad and the folding display that is worn on the wrist according to an embodiment of the invention;
Figure 23 b shows keypad and the folding display that is worn on the wrist according to an embodiment of the invention;
Figure 23 c shows the folding keypad that is worn on the wrist according to an embodiment of the invention;
Figure 24 a shows the keypad with folding display according to an embodiment of the invention;
Figure 24 b shows the keypad with folding display according to an embodiment of the invention;
Figure 25 a shows the keypad with folding display according to an embodiment of the invention;
Figure 25 b shows the keypad with folding display according to an embodiment of the invention;
Figure 26 shows the keypad with adjutage according to an embodiment of the invention;
Figure 27 shows the keypad with adjutage according to an embodiment of the invention;
Figure 27 a shows the keypad with adjutage according to an embodiment of the invention;
Figure 27 b shows the keypad with adjutage according to an embodiment of the invention;
Figure 28 shows keypad according to an embodiment of the invention;
Figure 29 shows microphone according to an embodiment of the invention;
Figure 29 a shows keypad according to an embodiment of the invention and microphone combination;
Figure 30 shows earphone according to an embodiment of the invention;
Figure 31 shows earphone according to an embodiment of the invention and keypad combination;
Figure 32 shows earphone according to an embodiment of the invention;
Figure 33 shows keypad according to an embodiment of the invention;
Figure 34 shows voice recognition chart according to an embodiment of the invention;
Figure 35 shows voice recognition chart according to an embodiment of the invention;
Figure 36 shows voice recognition sample according to an embodiment of the invention;
Figure 37 shows voice recognition chart according to an embodiment of the invention;
Figure 38 shows voice recognition chart according to an embodiment of the invention;
Figure 39 shows voice recognition chart according to an embodiment of the invention;
Figure 40 shows voice recognition chart according to an embodiment of the invention;
Figure 41 shows voice recognition chart according to an embodiment of the invention;
Figure 42 shows conventional keyboard according to an embodiment of the invention;
Figure 43 shows keypad according to an embodiment of the invention;
Figure 43 a shows keypad according to an embodiment of the invention;
Figure 43 b shows keypad according to an embodiment of the invention;
Figure 44 a shows keypad according to an embodiment of the invention;
Figure 44 b shows keypad according to an embodiment of the invention;
Figure 45 shows keyboard according to an embodiment of the invention;
Figure 45 a shows keypad according to an embodiment of the invention;
Figure 45 b shows keypad according to an embodiment of the invention;
Figure 45 c shows keypad according to an embodiment of the invention;
Figure 45 d shows keypad according to an embodiment of the invention;
Figure 46 a shows keypad according to an embodiment of the invention;
Figure 46 b shows keypad according to an embodiment of the invention;
Figure 46 c shows keypad according to an embodiment of the invention;
Figure 47 a shows the keypad with display according to an embodiment of the invention;
Figure 47 b shows the keypad with display according to an embodiment of the invention;
Figure 47 c shows the keypad with display according to an embodiment of the invention;
Figure 47 d shows the keypad with display according to an embodiment of the invention;
Figure 47 e shows the keypad with display according to an embodiment of the invention;
Figure 47 f shows the keypad with display according to an embodiment of the invention;
Figure 47 g shows the folding paper of standard according to an embodiment of the invention;
Figure 47 h shows the folding paper of standard according to an embodiment of the invention;
Figure 47 i shows the folding paper of standard that has keypad and show printer according to an embodiment of the invention;
Figure 48 shows keypad according to an embodiment of the invention;
Figure 49 shows the table with keypad and display according to an embodiment of the invention;
Figure 49 a shows the table with folding keypad and display according to an embodiment of the invention;
Figure 49 b shows the table with keypad and display of closing according to an embodiment of the invention;
Figure 50 a shows the appearance of the folding table with keypad of closing according to an embodiment of the invention;
Figure 50 b shows the appearance of the folding table of opening with keypad according to an embodiment of the invention;
Figure 51 shows keypad according to an embodiment of the invention;
Figure 51 a shows keypad according to an embodiment of the invention;
Figure 51 b shows keypad according to an embodiment of the invention;
Figure 52 shows keypad according to an embodiment of the invention;
Figure 53 shows keypad according to an embodiment of the invention and display;
Figure 54 shows keypad according to an embodiment of the invention;
Figure 55 a shows keypad according to an embodiment of the invention;
Figure 55 b shows keypad according to an embodiment of the invention;
Figure 55 c shows the keypad on hand the user according to an embodiment of the invention;
Figure 55 d shows microphone according to an embodiment of the invention and camera;
Figure 55 e shows microphone according to an embodiment of the invention and camera;
Figure 55 f shows folding keypad according to an embodiment of the invention;
Figure 55 g shows the button that is used for keypad according to an embodiment of the invention;
Figure 55 h shows the keypad on the mouse according to an embodiment of the invention;
Figure 55 i shows the downside of the mouse on the keypad according to an embodiment of the invention;
Figure 55 j shows earphone according to an embodiment of the invention and has the microphone of keypad;
Figure 56 shows keypad according to an embodiment of the invention;
Figure 56 a shows keypad according to an embodiment of the invention;
Figure 56 b shows keypad according to an embodiment of the invention;
Figure 57 shows keypad according to an embodiment of the invention;
Figure 57 a shows keypad according to an embodiment of the invention;
Figure 58 a shows keypad according to an embodiment of the invention;
Figure 58 b shows keypad according to an embodiment of the invention;
Figure 58 c shows keypad according to an embodiment of the invention;
Figure 59 a shows keypad according to an embodiment of the invention;
Figure 59 b shows keypad according to an embodiment of the invention;
Figure 60 shows keypad according to an embodiment of the invention and display cover;
Figure 61 a shows keypad according to an embodiment of the invention;
Figure 61 b shows keypad according to an embodiment of the invention;
Figure 61 c shows keypad according to an embodiment of the invention;
Figure 62 a shows keypad according to an embodiment of the invention and display;
Figure 62 b shows keypad according to an embodiment of the invention and display;
Figure 63 a shows keypad according to an embodiment of the invention and display;
Figure 63 b shows keypad according to an embodiment of the invention and display;
Figure 63 c shows keypad according to an embodiment of the invention and display;
Figure 63 d shows keypad according to an embodiment of the invention and display;
Figure 63 e shows and is according to an embodiment of the inventionly wearing overhead keypad and display;
Figure 64 a shows keypad according to an embodiment of the invention and display;
Figure 64 b shows folding keypad according to an embodiment of the invention and display;
Figure 65 a shows keypad according to an embodiment of the invention and display;
Figure 65 b shows the rear side of keypad according to an embodiment of the invention and display;
Figure 65 c shows keypad according to an embodiment of the invention and display;
Figure 66 shows a plurality of keypads and the display that connects by master server/computing machine according to an embodiment of the invention;
Figure 67 shows the keypad with loop sensor form according to an embodiment of the invention;
Figure 68 shows keypad according to an embodiment of the invention and display;
Figure 68 a shows display according to an embodiment of the invention;
Figure 69 shows keypad according to an embodiment of the invention;
Figure 69 a shows keypad according to an embodiment of the invention;
Figure 69 b shows keypad according to an embodiment of the invention and display;
Figure 70 a shows flexible display according to an embodiment of the invention;
Figure 70 b shows the flexible display with keypad according to an embodiment of the invention;
Figure 70 c shows the flexible display with keypad according to an embodiment of the invention;
Figure 70 d show according to an embodiment of the invention close have a display that opening of keypad contracted;
Figure 70 e show according to an embodiment of the invention open have a display that opening of keypad contracted;
Figure 70 f shows the flexible display with keypad and printer according to an embodiment of the invention;
Figure 70 g shows the folding display with keypad of closing according to an embodiment of the invention;
Figure 70 h shows the folding display of opening with keypad according to an embodiment of the invention;
Figure 71 a shows the flexible display with keypad and antenna according to an embodiment of the invention;
Figure 71 b shows the flexible display with keypad and antenna according to an embodiment of the invention;
Figure 71 c shows the display with keypad and extendible microphone according to an embodiment of the invention;
Figure 72 a shows the wrist strap of electronic equipment according to an embodiment of the invention;
Figure 72 b shows the flexible display of tiing that is in closed condition according to an embodiment of the invention;
Figure 72 c shows the flexible display of tiing that is in open mode according to an embodiment of the invention;
Embodiment
Detailed description of preferred embodiment:
Below described the present invention relates to a kind of on the keypad of button with limited quantity the collocation method of symbols (for example symbol of computer keyboard) such as character, punctuate, function for example, the sound/speech that the button of described limited quantity is used for common data input and is used for especially having made up the user and the button on the keypad be the data and/or the text entry method of (for example pressing) alternately.This method makes the use of this keypad easier.
Fig. 1 shows to use and presses and the example of the integrated keypad 100 that is used for the data input method of sound/speech recognition system.In this embodiment, the button of keypad can responding one or more types and its alternately.Described for example can be alternately:
-use the part (using the finger recognition system) of specific finger or finger to push button;
-click (for example single is pressed) button or double-click (for example the short period at interval in double pressing) button;
-press (perhaps touching) button lightly, perhaps push button than the important place.
-with button mutual in short time (for example pushing button in short time) or push button for a long time etc..
Can distribute to each described mutual or these mutual combination with the button of described keypad to the class symbol on the described keypad.For example, can give the button of clicking keypad the allocation of symbols shown in the top of the button of keypad 100.For example, if the user pushes button 101, can select symbol " DEF3. ".In identical example, can give the allocation of symbols that the bottom disposed of the button of keypad 100 and for example double-click described button.For example, if the user double-clicks button 101, then selected symbol " { } ' ".
According to the system that the button that uses keypad is realized, it also is possible using foregoing other to carry out identical selection alternately.For example, press (perhaps touching) button 101 lightly and can select the symbol that top disposed of described button, and press the symbol that the bottom disposed that identical button can be selected described button than the important place.
As described, when the user contacted with button, recognition system made the symbol on the mutual described button of distributing to described type become candidate symbol.For example, if the user touches or pushes button 102 lightly, then system makes symbol " A ", " B ", " C ", " 2 " and ", " become candidate symbol.For one of described candidate symbol is selected, described user can say the location name of for example described symbol or the described symbol on described keypad.For this purpose, the sound/speech recognition system is used.
If the user is silent, can select predetermined symbol in these candidate symbol as default value.In this example, selected at the punctuate ", " shown in the square frame 103.In order to select other a candidate symbol, letter " B " for example, the user can say described letter.
In identical example,, then can make symbol " [", "] " and " " " is as candidate symbol if the user pushes button 102 than the important place.As previously mentioned, if the user is silent, then the predetermined symbol in those symbols of selecting by described actuation of keys can be selected as default value.In this example, " " " is selected for punctuate.Still in this example, in order in other two candidate symbol " [" or "] ", to select required symbol, the user can use diverse ways, for example say described required symbol, and/or say the position relevant with other symbols, and/or say its color (if each symbol has different colors), and/or distribute to any predetermined title (for example predetermined sound or the voice that send by the user) of described symbol.For example, if the user says " left side ", then select symbol " [".If the user says " right side ", then select symbol "] ".
Certainly, with user behavior rather than the use voice that button combines alternately, also can select symbol.For example, the user can push button 102 than the important place, and thumps to required symbol with finger.
Above-mentioned data entry device can also be applied to have to carrying out the keypad (standard telephone keypad that for example, has button) of the described button that responds alternately of single type with button.As shown in Figure 2, keypad 200 has carrying out the single button that responds alternately with button.When the user pushed button, system made all symbols on described button become candidate symbol.For example, if the user pushes button 202, then symbol " A ", " B ", " C ", " 2 ", ", ", " [" and "] " become candidate symbol.
In this example, if the user is silent, then the default symbol of being scheduled to can be selected by system.In this example, punctuate ", " 203 is selected.
Still in identical example, in order in described candidate symbol, required symbol to be selected, the user can say required symbol, perhaps for example say the location name of described symbol on described button, perhaps say location name relevant with other symbols on described keypad, perhaps say foregoing any other title.For example, the symbol in those symbols that can be disposed button top by saying this symbol is selected (for example " A ", " B ", " C " or " 2 ").On the other hand, for example, can by say its with respect to for example in the position of two other symbols of described button bottom, for example by say " left side ", " in " or " right side ", and can select one of symbol that the bottom disposed of button.For example, " [" 204, the user can push button 202, and says " left side " in order to select.
As described, the button on the keypad of Fig. 1 can responding at least two kinds of predefined types that carry out with it alternately.The all types of one group of described character on described button that can make alternately that carries out with button on the described keypad becomes candidate characters.
As previously mentioned, during the data input that for example writes text, may need different mutual (for example click, double-click) with button, and the different user behavior (for example say, do not say) that combines alternately with described button.Though data entry device of the present invention is the inputs of quick and easy data,, the better configuration of symbol may produce easier and data entry system faster on the button of keypad of the present invention.This method will be described below.
According to an embodiment, as shown in Figure 3, a plurality of symbols (for example symbol on the computer small keyboard) are at least two groups by actual division, and by their priority (frequency of utilization for example, the user is for familiarity of the existing layout of some symbols of the letter and number on for example standard telephone keypad etc. etc.) be disposed on the button of telephone keypad, as described below:
Be assigned to button and carry out mutual first group of the first kind
A) first group of use sound/speech
Can be arranged on digital 0-9 and alphabetical A-Z on the button of keypad according to standard configuration, and it is distributed to mutual (for example first level pushes) with the first kind of described button.By carrying out alternately (for example the first kind is mutual) with respective keys and saying described symbol naturally, can select the required symbol in these symbols.In Fig. 3, described symbol (for example 301) is configured in the top of button.
During for example text was imported, letter and number may often be used.When for example knocking respective keys, can say these letter and numbers naturally.Thus, for the input of quicker and easy data, preferably, these letter and numbers are distributed to mutual with the same type of the button of keypad.
B) do not use second group of sound/speech
Can be (for example other symbols that during data (for example text) input, often use, punctuate, function etc.) at least a portion be arranged on the button of keypad (symbol of each button), and it is distributed to mutual (for example clicking) with the described first kind of described button.As acquiescence, can be only mutual by with respective keys, and do not use voice/sound that required symbol is selected.In Fig. 3, described symbol (for example 302) is set in the square frame on the top of described button.
Certainly, can also be by it being selected carrying out saying described symbol in mutual with respective keys, but because to say this symbol (for example punctuate, function) after all be not the behavior of nature, thus, preferably, do not say these symbols.
Distribute at least the second group of carrying out at least the second mutual type with at least one button
Can distribute to mutual with at least the second type of the described button of described keypad at least a portion of residue symbol.They can be divided into following two groups:
C) do not use the 3rd group of sound/speech
Can and be difficult to and/or the 3rd group of symbol that can't natural pronunciation is arranged on the described button of described keypad (symbol of each button) the symbol that comprises remaining frequent use, and it is distributed to and second type of described button mutual (for example double-click, heavier by voltage levels, press two buttons, the part of finger by its touch key-press simultaneously, etc.).
As acquiescence, can be only described mutual by with respective keys, and do not use voice/sound to select required symbol.In Fig. 3, the described symbol of configuration (for example 303) in the square frame on the button bottom.
Certainly, can also be by selecting them carrying out saying these symbols in mutual with respective keys, but because to say this symbol (for example punctuate, function) after all be not non-human act, thus, preferably, do not say these symbols.
D) at least the four group of use sound/speech
Can be described second type of the button of the 4th small component dispensing that comprises at least a portion that remains symbol and described keypad mutual, and combine with the user behavior of for example sound.In Fig. 3, the described symbol of configuration (for example 304) on the button bottom.Can select described symbol by the sound/speech under and the use different modes mutual with described second type of respective keys, described different modes comprises:
-select symbol by the title of saying them naturally
-by saying their positions respect to one another on button naturally, perhaps in text, use their position (for example "＜" in this example, "＞" in them, it is mutual that described symbol does not belong to described second type, this only is an example), for example, select described symbol by saying " left and right, open and close etc. ".
(can use hardly) of-considerably less use and/or the symbol that is difficult to pronunciation (for example 304).For quick and easy data entry device, can also by say they in the position on the button or their positions respect to one another on described keypad select described symbol.Certainly, can for example select these symbols by using to its other voice that pronounce.
E) other
If desired, can wait for example " F1-F12 " other symbols to be arranged on the button of keypad, and distribute mutual type to it.For example, can distribute to described second type mutual (use or without voice) to them, perhaps it be distributed to another kind of alternately, for example side by side press two buttons, knock respective keys for three times, use switch to enter another pattern etc.
Strengthen more considerations that keypad and keypad use
Owing to can be arranged on digital 0-9 and alphabetical A-Z on the button of keypad according to standard configuration, and they distribute to and mutual (for example first level push, click etc.) of the first kind of the described button that combines of voice, for example some buttons of 311,312,313 and 314 can be included in the maximum symbols (for example in numeral on the button 311 1 or the numeral on button 313 0) that use in the described configuration.Thus, in order to use described button better, can be added on the described button by symbol 321-324 easy some and natural pronunciation, and it is distributed to the mutual of the described first kind.For example, the user can select symbol " (" by using with the mutual of the first kind of button 311 and saying for example " left side " or " opening ".In order to select symbol ") ", the user can use with the mutual of the identical first kind of described button 311 and say for example " right side " or " pass ".For described symbol, this is quick and even more important natural-sounding.Because the quantity of distributing to the mutual candidate symbol of the described first kind on described button 311-314 is no more than the quantity of the candidate symbol on other buttons, speech recognition system still can have and the similar degree of accuracy of other buttons.
Some symbols can also use in two kinds of patterns (with button mutual).Described symbol can be more than once being configured in (for example on the one key or on different buttons) on the keypad, and it is distributed to mutual and/or second type is mutual with the first kind of respective keys.
Fig. 3 shows the preferred embodiments of the present invention that are used for Computer Data Entry System.The button of keypad 300 responds two or more distinct interactions on it (for example varying level pushes, clicks or double-click etc.).Go out as shown, for example a plurality of symbols of alphanumeric symbol, punctuate, function and PC order according to following mode profile in described button.
First group-alphabetical A-Z and digital 0-9 are the very frequent symbol that uses during the data input that for example writes text.Pressing respective keys simultaneously, can be easily, what is more important pronounces to these symbols naturally.Thus, can on the same side on the button that for example belongs to the same type mutual (for example first pattern) of clicking (for example single depression) button, these symbols be arranged together, and it be selected by saying these symbols.
Second group-for example punctuate and for example write the data input of text during the symbol of the very frequent function of using can belong to the mutual of same type, it is used to select described letter and number (for example described first pattern).That is, in input during data, The more the better alternately with the same type of button.Each button can only have described second a group described symbol.Can be only by pressing respective keys, not using sound and this class symbol is selected.In order to distinguish better, these symbols are displayed in the square frame on the button top (for example identical with being used for a letter and number side).
Other symbols of the described quantity of symbol are presented on the bottom of button of keypad.These allocation of symbols are given and second type of described button mutual (for example double-clicking).
The 3rd group-in default symbol shown in the square frame (for example needing those symbols that need to use sound alternately and not) with button.Described symbol comprises character, punctuate, function of the present less use of user etc.
The 4th group-last, less use and the symbol that can't risk naturally are positioned at the left side on the button bottom in this example in the data input.By these symbols being pronounced with corresponding mutual (for example the double-clicking) and (for example almost simultaneously) of respective keys, perhaps tell them, can select these symbols by saying predetermined voice or the sound (for example " left side; the right side " or " blueness; redness " etc.) of distributing to described symbol.
By using keypad, its have with dissimilar mutual (preferably, two types, thereby do not make the use complexity of button) corresponding button, and have some symbols that do not need voice (for example default symbol), when the button with described keypad carries out when mutual, perhaps required button (for example acquiescence) is by directly mutual, and perhaps to make selecteed candidate symbol be minimum to the user behavior by for example sound/speech.This has increased the accuracy of speech recognition system.
For example, when the user pushed button lightly, system was selected the symbol on the described button top at these symbols that are arranged on the described button.If the user uses voice simultaneously, then system is selected those symbols that need voice in described selected symbol.The data input that reduces the quantity of candidate characters and need the keypad of this process that speech recognition technology selects one of symbol button by having limited quantity to be used to have pin-point accuracy.Produce the process that reduces by the user's non-human act that for example pushes button and/or speak.
As shown in Figure 4, button 411,412,413 and 414 has needs interactive voice and distributes to described button and carry out a mutual symbol of the first kind.On the other hand, comprise need to carry out second type mutual and need two symbols of interactive voice with described button for the same button in the bottom.Described two symbols can be used (for example in arithmetic data input maybe when writing software etc., etc.) more continually than other symbols that belong to identical type.In this case, and in order when carrying out (for example pressing) alternately, also to make user's error minimization, can also give described allocation of symbols the described first kind of carrying out mutual with described button with button.It is lower that the sum of candidate symbol keeps.The user can need press described button according to it and also speak.
Additional layout can be arranged on the above-mentioned keypad, so that the user uses.For example, can be "-" and " _ ", " " " and " ' " or "; " and ": " be configured to default symbol on the same key 411, perhaps be configured on two adjacent key 415,416.Can also " Sp " and " " (for example Tab) regards default symbol as and is configured on the same key 412, each corresponding to dissimilar mutual (for example by the voltage levels) of described button.For example, by once pushing button 412, select character " Sp ".By double-clicking same key, select " tab " function.
When carrying out when mutual (for example once push button or double-click button) with button, by not discharging described button, with described mutual corresponding symbol (if desired, comprising voice) can be selected and be repeated, till discharging this button.For example, by double-clicking button 415 and after knocking for the second time, keeping button to press and silent, distribute to described mutual default symbol (“ ﹠amp for example; ") selected and be repeated, till the user discharges described button.For input alphabet " X " and repeat this letter, the user can for example press respective keys 415 (not discharging this button) and say " X ".Letter " X " will be repeated, till the user discharges described button.
And the outward appearance of being familiar with more for keypad can dispose according to standard telephone keypad, letter, digital and for example the character of " # " and " * " be arranged on the described button.
Other buttons that are arranged with the button branch of described keypad can be used to comprise some described symbols and other symbols.In the example of Fig. 6, the button that the button branch by at least one and keypad 600 is arranged navigates to cursor on different directions.Single button 601 can be assigned to all directions 602.For example, the user can press described button, and says " upper and lower a, left side or right ", so that on respective direction cursor is navigated.Button 601 can also be multidirectional button (for example similar with employed those buttons in video-game or in some cell phones, so that navigate in menu).Therefore user's 601 go up, right, down or the left side that can push button so that navigate to cursor.Can also distribute a plurality of other buttons, for example, each for example distribute to " " at least one symbol.
Described additional button can be the existing button on electronic equipment.For example, in cell phone, except 12 buttons of standard telephone keypad, for example other function buttons such as menu key or on/off key are set also.When system for example was in text entry mode, the part of these buttons can be used as other data input button at least, and it comprises a plurality of symbols.This has discharged some spaces on the button of standard telephone keypad.The space that is discharged can allow the more user-friendly configuration of symbol on the button of speech recognition system more accurately and/or keypad.
Example shown in above-mentioned collocation method and the front only is illustrated as an example.Certainly, symbol multiple other configuration and for also considering with the different task of the mutual different user of button.For example, button can not have default symbol, or can not distribute to the symbol of sound/speech on button.
And all buttons that are not keypad can responding same type alternately.For example, first button of keypad can respond pushing of two kinds of levels, and another button of identical keypad can respond clicking or double-click button.
Fig. 1-7 shows the difference configuration of symbol on the button of keypad.
By computer small keyboard, above-mentioned data entry system for example allows all data input of notebook data input in full.By importing for example symbols such as letter, punctuation mark, function one by one, can import word and sentence.
This will influence the telecommunication market that permission strengthens the multiple application used and method greatly.Their part is listed hereinafter.Be appreciated that above-mentioned mutual any combination can be used to import required symbol.
According to one embodiment of present invention, the user uses sound/speech with the input required symbol of letter for example, and do not need for example to push button other are mutual.The button (for example single keys presses, twice button, three buttons etc.) that the user can use keypad to be importing for example symbol of punctuate, and need not to say these symbols.
Be appreciated that described in this application data entry device can be applied to for example every other language such as Chinese, Korean, Japanese.
The correction of symbol and repetition
Diverse ways can be used for the symbol of error recovery input.As mentioned, for incoming symbol, the user can for example press respective keys, and says the described required symbol that disposes on described button.Following situation might take place, that is, the sound/speech recognition system is misread user's voice, and the non-required symbol that disposes has been selected by system on described button.
For example, if the user:
A) before the next required symbol of input, identify the symbol (for example cursor is positioned in after the symbol of described mistake, is close to it) of wrong input, then the user can carry out trimming process, and it makes an explanation in the back;
B) after the next at least symbol of input, identify the symbol of wrong input, then the user can be at first for example button 101 (Fig. 1) by having navigation feature or the corresponding manner of 202 (Fig. 2) in text, navigate, and cursor positioning after the symbol of described mistake, adjacent this symbol.Then, the user carries out trimming process, and it makes an explanation in the back;
Cursor positioning in the back of described mismark and after adjacent this symbol, the user can retell described required symbol or its location name, and do not need to press again described respective keys.If system has reselected the identical symbol of being deleted, then system will automatically abandon described selection, and select symbol in the residue symbol that on described button, disposes, wherein, the title of this symbol or its location name are corresponding to the possibility next the highest accordingly with described user's voice.If still selected wrong symbol by system, then the process that retells in required symbol and the residue symbol on described button the next symbol of selecting to have high likelihood by the user can continue, till having selected required symbol by system.
Be appreciated that, in use has data entry system to the keypad of pushing the button that responds of for example two kinds of levels, when carrying out timing, recognition system can at first be selected symbol in belonging to those symbols of same-sign group, described same-sign group belong to request select described mistake symbol by voltage levels.If the user does not accept in these symbols any one, then system can belong on described button in another symbol by voltage levels symbol is selected.
Fig. 7 b shows the process flow diagram corresponding to the embodiment of bearing calibration.If for any reason, the user wants to proofread and correct the symbol of having imported, and then the user can enter this trimming process.
Trimming process starts from step 701.If the symbol that substitutes is not positioned on the button identical with symbol that will be replaced (702), then replaced symbol (704) is wanted in user deletion, and by pressing respective keys, and if desired, use the voice that increase that the symbol that substitutes is imported (706), withdraw from (724) then.
If the symbol that substitutes is positioned on the button identical with wanting replaced symbol (708), and the symbol that substitutes do not need voice (710), and then system enters step 704 and 706, and so play aforesaid effect, withdraw from (724) then.
If the symbol that substitutes is positioned on the button identical with wanting replaced symbol (708), and alternative symbol do not need voice (712), then will consider two kinds of possibilities:
A) cursor is not positioned at (714) after the symbol of wanting replaced.In this case, the user enters next step 718 then to cursor positioning adjacent this symbol (716) also after wanting replaced symbol;
B) cursor is positioned at (714) (for example the user identifies the symbol of wrong input immediately) after the symbol of wanting replaced.In this case, the user enters next step 718;
In step 718, the user says required symbol and does not press button.Only do not speak by not pressing button, system understanding belongs to the symbol that is positioned at cursor button before and must be replaced by another symbol that belongs to same key.Then, (720) will be selected to symbol by system in all the other symbols (for example comprising selecteed symbol) on the described button that has with the corresponding high likelihood of described voice.If the new symbol of selecting still is non-required symbol (722), then system (and user) is re-entered at step 718 place.If selected symbol is required symbol, then system withdraws from trimming process (724).
Certainly, except said method, can also provide the method for traditional correction symbol.For example, in order to proofread and correct the symbol of having imported, the user can easily at first delete described symbol, and then by pressing respective keys, and if desired, use the voice that increase, re-enter new symbol.
Text input system also can be applied to word level (for example the user says word and imports by the use keypad).Identical text input process can be imported (for example for the word that is included in the database) and character level input in conjunction with word level.Thus, above-mentioned trimming process can also be applied to the input of word level data.
For example, in order to import word, the user can say described word and press respective keys.If owing to for example reason such as eliminating to having ambiguity between two words that close pronunciation and similar button press, recognition system has been selected non-required word, then the user can retell described required word, and does not press described respective keys again.Then, system will (for example comprise selecteed word) word that has high likelihood corresponding to described voice will be selected in the remainder of the word candidate of pressing corresponding to described button.If the new word of selecting also is not required word, then the user can retell described word.Repeat this process, till having selected described required word by system or not had other word candidate.In this case, the user can import described required word by for example preceding described character input system.
Be appreciated that in word level when carrying out timing, cursor should be positioned at after the described word that will be replaced.For this purpose, and for fear of the ambiguity of character correction mode, when revising whole word (word correction level), the user can be cursor positioning after described word that will be replaced, wherein, at least one space character carries out the interval to described word and described cursor.This be because, for example, if the user wants to proofread and correct last character of having imported word, the user should cursor positioning adjacent after described character.By cursor positioning after at least one space of word back (perhaps next line begin the place, if last word that described word is a previous row), and speak and do not press button, then system identification goes out last word before the user may wish to proofread and correct cursor.For better result, be appreciated that if replaced word comprise punctuation mark (for example ". ", "? ", ", " etc.), can be put back into cursor after the space of punctuation mark back.This is that the user may wish the punctuation mark of the mistake that must be positioned at the word end is made amendment because in some cases.For this purpose, the user can cursor positioning adjacent after described punctuation mark.
For fear of unexpected correction (for example cursor is arranged in text somewhere, and the user does not want to carry out the data input in a minute), then can use diverse ways.For example, when the user wishes for example to have a rest during the text input, then can use and suspend or non-text button.Another solution is: after on cursor positioning certain position in text, through after a while (for example two seconds) afterwards, system is not received in the word last before the cursor or the correction of character.If the user wishes to proofread and correct described word or described character, the user can for example navigate (moving once to any direction at least) to described cursor, and it is put back to described desired location.After cursor is repositioned at desired location, will the time be counted from beginning, and the user should before being cut off, proofread and correct described word or described character the described time period.
Replicator
In order to repeat required symbol, the user at first presses respective keys, and if desired, perhaps say described symbol, perhaps the user say in the location name of its above symbol of respective keys or on according to described button other symbols say the location name of described symbol.Then, required symbol is selected by this system.The user continues to press described button and does not interrupt.After the preset time section, system identification goes out the user and wants to repeat described symbol.System carries out repetition to described symbol, stops to press described button up to the user.
Should be noted that above-mentioned correction and repeat key symbol method can with include but not limited to click/double-click, touch-sensitive buttons, the button of pressing simultaneously, only any input method of some button that is pressed etc. combines use.
Telephone directory
In order to carry out call, the user can want called destination by any information input of for example name (for example people, company etc.), rather than dialing, and if desired, imports for example described more information of wanting called party address etc.Central telephone is thin can be described calling self-orientation to described destination.If exist distribute to described destination (for example the other side) more than one telephone line, perhaps exist more than a selection for described information needed by user's input, can be sent to the phone of calling party to corresponding selective listing (for example telephone number or distribute to any other predetermined outfit of described telephone line), and for example on the display unit of its phone, show.Then, the user can select required selection, and carries out call.
Above-mentioned calling (for example dialing) method can allow to eliminate the needs to by his/her telephone number call peer (for example individual).Thus, can eliminate to storing phone number, portable phone this or utilize the needs of operator's help.
Use the mutual Shen words book of sound/speech
The voice call book is more and more by uses such as company, public organizations.It is process very consuming time and trouble for the user that this and the opposing party carries out mutual method.Many people disconnect communication by the voice call book of listening at the phone opposite side.Even manage to carry out when mutual with described system as the individual, often occurring in after the cost plenty of time, calling party can not successfully be visited required service or individual.The main cause of this ambiguity is that in most cases the user must wait for, up to having announced Total Options when listening to the indication of voice call book.In most cases, he (user) do not remember all selections of being announced.Therefore he must listen to these selections again.
And in most cases, the voice call book need be by user input data.Because the limited quantity of the button of telephone keypad, perhaps owing to pass through the complicacy of keypad incoming symbol, the variation of data input is restricted.
Above-mentioned data entry device allows to carry out rapid visual mutual with telephone directory.The called party can be sent to calling party to visual mutual telephone directory, and calling party almost can be seen all selections immediately, and uses his telephone keypad (comprising above mentioned data entry system) easily and apace problem to be responded or the inquiry problem.
Voice mail
Voice mail can also be substituted by text-mail.This method is used.When the user must answer message or write message to the opposing party to the opposing party, the advantage of above-mentioned data entry device was conspicuous.Data entry device of the present invention has also strengthened significantly by for example use of the message system of cellular mobile electronic device.A kind of use of knowing most is in Short Message Service (SMS).
It is huge using the quantity of the electronic equipment of telephong type keypad.Data entry device of the present invention allows the data input of significantly enhancing by the keypad of described equipment.Certainly, this method is not limited to the telephong type keypad.This method can also be used for any keypad, and wherein, at least one button of described keypad comprises more than a symbol.
Manifold keypad
Have manifold keypad by use, use the size of the keypad of above-mentioned data entry device to be minimized.When being in closed condition, described keypad can minimize (for example the same with the best part big dimensionally, for example the button with the size of adult's user finger tip or little keypad is the same big), and when keypad is in open mode, can be maximum (according to a quantity of the part of using and/or opening) as required.
In theory, when being in closed condition, keypad even can have the size of the button of described keypad.
Fig. 8 shows an embodiment of the described keypad 800 that comprises at least three parts 801, and wherein, each described part comprises a row button of telephone keypad.When described keypad is in open mode, provide telephong type keypad 800.When being in closed condition 802, described keypad can have the width of one of described part.
Fig. 9 shows another embodiment of described keypad.Described keypad 900 comprises at least two part 901-902, and wherein, first 901 comprises two row button 911-912 of telephong type keypad, and the second portion 902 of described keypad comprises the 3rd row 913 of described telephong type keypad at least.When described button is in open mode, provide the telephong type keypad.Described keypad can also have the other key columns 914 that is arranged on the described second portion.When being in closed condition 920, described keypad can have the width of a described part.
As shown in figure 10, another embodiment of described keypad 1000 comprises at least four part 1001-1004, and wherein, each described part comprises delegation's button of telephone keypad.When described keypad is in open mode, provide the telephong type keypad.When being in closed condition 1005, the length of described keypad can be the size of width of delegation's button of described keypad.
Figure 11 shows another embodiment of the described keypad 1100 that comprises at least two part 1101-1102, wherein, first comprises two row buttons of telephong type keypad, and the second portion of described keypad comprises the other two row buttons of described telephong type keypad.When described keypad is in open mode, provide the telephong type keypad.When being in closed condition 1103, the length of keypad can be consistent with the width dimensions of delegation's button of described keypad.
In the patented claim of having submitted, above-mentioned manifold keypad is described by the inventor.
By using the above-mentioned data entry device that passes through manifold keypad as described, can provide the wield all data input small keyboard of miniaturization.This keypad can be used in many equipment, particularly has those equipment of the size of restriction.
Certainly, can on described manifold keypad, use above-mentioned symbol configuration.
Figure 12 shows another embodiment of manifold keypad 1200.The distance that has between the part of button 1201 can increase by any method.For example, can be arranged on empty (for example not comprising button) part 1202 between the part that comprises button.When described keypad is in open mode, this will allow to increase more the distance between the each several part.On the other hand, when being in closed condition 1203, also allow to have thinner keypad.
Data input device with integrated keypad and mouse or sensing and pointing device
In order to pass through common keypad and particularly to pass through keypad of the present invention, strengthen data entry device, can be being the sensing of mouse hereinafter and clicking the system integration that the front of this electronic equipment has the keypad that is used for the data input at the back side of electronic equipment.
Figure 13 shows for example electronic equipment of cell phone 1300, and wherein, the user holds this equipment in its palm 1301.Described user can only use the described equipment 1300 of handgrip to be held in its hand, and operates its keypad that is positioned at the front 1303 simultaneously, and the mouse or sensing and the pointing device (not shown) that are positioned at the described equipment back side.Described user's opposing thumb 1302 can be used keypad 1303, and its forefinger 1304 can be operated described mouse (going up overleaf).Other three fingers 1305 can help equipment is held in user's the hand.
Being integrated in the mouse at the described equipment back side or sensing and pointing device can have and the similar function of computer mouse.Can also give mouse click function a plurality of buttons of telephong type keypad (for example two buttons) or a plurality of key assignments in other buttons of described equipment.For example, button 1308 and 1318 can move with the integrating mouse of described equipment 1300, and has and the similar function of the button of computer mouse.Described button can have and the computer mouse identical functions.For example, by the operation mouse, the user can select (pointer) designator 1306 to navigate to the routine on the screen 1307 of described equipment, and it is positioned on the required menu 1311.As to computer mouse, described user then can for example click the predetermined key 1308 (it is assigned to mouse) in (click) or double-click (twice click) described keypad, thereby can for example select or open described required menu 1311, it is directed by described conventional (pointer) designator 1306 of selecting.
Because for example the display of cellular mobile device has less size, thus, turn knob 1310 can be set in described equipment, thereby make the user can for example rotate menu list.For example, on screen 1307, occur after the required menu 1311, the user can use mouse routine to be selected (pointer) designator be placed on the described required menu, and the first-class of other buttons 1308 on one of button 1313 by using telephong type keypad 1303 for example or the described equipment is selected it.
As for computing machine, the user then can press described button to open relevant menu bar 1312.For the function 1313 of selecting described menu bar 1312, the user can keep pressing described button, and after being placed on the described function, by discharging described button, can select described function to normal selection (pointer) designator 1306.
By using described keypad and described mouse, can provide functionally similar other functions with computing machine.
And the user can use predetermined sound/voice or other predefined actions to replace the function of described button, and does not use the described button of distributing to mouse.For example, after being positioned at normal selection (pointer) designator 1306 on the icon, the user can say " selection " or " opening ", rather than pushes button, to select or to open by the represented application of described icon.
Figure 14 shows for example electronic equipment of mobile phone 1400.The a plurality of different icon 1411-1414 of expression different application is shown on the screen 1402 of described equipment.In order to select and/or open one of application, as for computing machine, by using mouse, the user can select routine (pointer) designator 1403 to be placed on the required icon 1411.Then, described user can select described icon by for example once pressing the predetermined key 1404 of described keypad.In order to open the application by described icon representation, the user can for example double-click the predetermined key 1404 of described keypad.
Integrated mouse can be an any kind on the back side of electronic equipment.For example, Figure 15 shows for example back side of the electronic equipment 1500 of the electronic equipment shown in Figure 13-14, and mouse 1501 is similar with traditional computer mouse.As described, can utilize user's finger manipulation mouse 1501.On the surface that described equipment is placed on desktop for example, and on described surface, knock described mouse, can resemble and operate mouse traditional computer mouse.
Figure 16 shows the mouse (responsive pad) of another integrated on the back side of the electronic equipment shown in Figure 13-14 1600 for example traditional type.Mouse 1601 is similar with traditional computer mouse.As described, can utilize user's finger to operate on it.In this example, preferably, as previously mentioned, when being held in this equipment in its palm, the user uses its forefinger 1602 to use (for example going operation) described mouse.According to this position, the user uses its thumb (not shown) to remove to operate button in the keypad (not shown), and it is positioned at the front (for example another side) of described equipment.
Preferably, mobile device should be only with a manual manipulation.This is (for example on motorbus or train time) because when the user is moving, and subscriber station can use the another hand to be used for for example holding other purposes of cross bar aboard the time, perhaps uses one and holds newspaper or briefcase).
Use mouse by the back side at the equipment of for example mobile phone, the user can utilize the described equipment of manual manipulation and import data.This user can use the keypad and the mouse of described equipment simultaneously.
Certainly, if the user wishes that described user can use his two hands to operate described equipment and mouse thereof.
The another kind of method of using described equipment is that it is placed on the surface of desktop for example, and with the mode identical with the computer mouse of the routine described equipment that on described surface, slides, and use described keypad input data.
Be appreciated that and be integrated in the mouse of any kind that comprises aforementioned mouse in any part of mobile device.For example, mouse can be positioned at the front of described equipment.Described mouse can also be positioned on the side of described equipment, and as previously mentioned, operates mouse and keypad simultaneously by finger.
Should note, mouse is being used to whole from beginning in this is discussed, but, be integrated in the electronic equipment and any sensing of for example pen-based computer that combines with the telephong type keypad (stylus computer) and click data input equipment all within conception of the present invention.
Outside integrated data input cell
In the electronic equipment of the data input device of for example big keyboards of needs (or keypad) and/or mouse, can also be provided with and use the outside integrated data input cell that comprises keypad and mouse.Integrated data input cell can be set, and its front in described unit has the button of keypad (for example telephong type keypad), and has the mouse in the back side that is integrated in described unit.Can link to each other described data input cell with for example equipment needed therebies such as computing machine, PDA(Personal Digital Assistant), camera, televisor (TV), facsimile recorder.
Figure 19 shows the computing machine 1900 that comprises big keyboard 1901, mouse 1902, monitor 1903 and other computer annex (not shown).(for example working as the user does not want to be sitting on the chair of monitor front in some cases, and the bed that would rather lie in him go up simultaneously with described computing machine carry out when mutual), the user can use less outside integrated data input cell, rather than big keyboard and/or corresponding mouse.External data input block 1904 can be set, it comprises following feature, promptly, for example be positioned at the keypad keys 1911 of described data input cell front, can be the microphone of extendible microphone 1906, be integrated in the mouse (not shown) (as previously mentioned) in the back side of described data input cell.Described data input cell can (wirelessly or pass through lead) link to each other with described electronic equipment (for example described computing machine 1900).Described integrated data entry system for example (for example by the mutual speech recognition system that combine of user's use with button) can be integrated in described electronic equipment (for example described computing machine 1900) inside, perhaps is integrated in described data input cell 1904 inside.Microphone can also be integrated in described electronic equipment (for example computing machine) inside.Described integrated data entry system can use and be positioned on the described data input cell or one or two microphones of described electronic equipment (for example computing machine).
In order better to watch when mutual carrying out, particularly when carrying out when mutual with the electronic equipment of for example described computing machine 1900 from afar, display unit 1905 can be integrated in the described input block inside of described integrated data input cell 1904 for example of the present invention.When carrying out when mutual with the watch-dog 1903 of described electronic equipment 1900 from afar, the user can arrive the display 1910 of described monitor 1903 on the whole.On the described display 1905 that can be simultaneously displayed on described data input cell 1904 by near the localized area 1908 the selected arrow of the mouse on the display 1910 that uses described monitor 1,903 1909 or other zones.Described regional 1908 size can be by manufacturer and user definition.Preferably, described regional 1908 size can approach the size of the display 1905 of described data input cell 1904.This can allow for the user approaching and/or if necessary, the view (for example by on data entry screen curtain 1905, watching described zone) of the physical size of interaction area 1908.When the general view of the display 1910 with monitor 1903, the user can have the approaching especially view of interaction area 1908, and it is displayed on the display 1905 of described data input cell 1904 simultaneously.For example, the user can use keypad mouse (not shown, on the back side of keypad) on graphoscope 1910 arrow 1909 is navigated.Simultaneously, the zone 1908 around described arrow 1909 on described graphoscope 1910 and the described arrow 1909 may be displayed on the keypad display 1905.
Mutual for what for example open file, the user can for example navigate to arrow 1909 on the screen 1910 of described computing machine, and it is positioned on the required file 1907.Described navigation area 1908 and described file 1907 can be in sight on described data entry screen curtain 1905.By having display 1905 near the described data input cell 1904 of its eyes, the user can be clear that his mutual on the display 1905 of described data input cell 1904, have overall view simultaneously on the big display 1910 of described electronic equipment 1900 (for example computing machine).
Be appreciated that and define and change described interaction area 1908 according to different needs or definition.For example, described interaction area can be the zone around the arrow 1909, wherein said arrow is positioned at the center in described zone, perhaps, described zone is the right side, a left side of described arrow, the zone of side such as upper and lower, or any zone on the screen of described monitor, and irrelevant with the described arrow locations on the display of described monitor.
Figure 20 shows for example data input cell 2000 that links to each other with computing machine 2001 of aforesaid data input cell.During the data input of for example text input, be simultaneously displayed on the keypad display 2004 on interaction point 2003 (for example cursor) zone 2002 on every side.
Figure 21 a-21b shows the example of distinct electronic apparatuses, and it can use above-mentioned data input cell.Figure 21 a shows computing machine 2100, and Figure 21 b shows TV 2101.The data input cell 2102 of described TV 2101 can also be as the telepilot of described TV 2101.For example, be positioned at the mouse (not shown) of described data input cell 2102 back by use, the user can be selecting arrow 2103 be positioned on the icon 2104 of expression film or channel, and the button by double-click (twice click) described data input cell 2105 is opened it.Certainly, the described data input cell 2102 of described TV for example can also be used for the data input by the Internet of TV, perhaps sends message by TV, wired TV etc.In this case, integrated data entry system of the present invention can be integrated in for example modulator-demodular unit 2106 inside of TV.
Extendible microphone
Can be integrated in extendible and/or rotating microphone in for example cellular electronic equipment.Described microphone can be the rigidity microphone to user's mouth extension.
Along with development of technology, new input system and equipment come into the market, thereby allow easily to carry out alternately with equipment.Many such input systems have been used the sound/speech recognition system, and wherein, the user says data or the order that will import.Because this is to import data in the mode of nature, therefore, it is very general that speech recognition system is becoming.Computing machine, phone, toy and many other equipment configurations have the different types of data entry system that uses speech recognition system.
Though this is an input method preferably, it has serious defective.This method is not the input method of being interrupted.Usually, the user do not want other people to hear him what is said or talked about, and on the other hand, people dislike other people speaking up.
In order to overcome (or reducing at least) this problem significantly, the user must speak in a quiet voice.For the sound/speech that does not make the user is mistranslated by speech recognition system, microphone must be near user's mouth.
The purpose of this invention is to provide and have the microphone that extends to user's mouth from described equipment, use the equipment of user's voice as data.
Use this microphone to have many advantages.One of advantage of this microphone is: by described microphone is spoken to described user's mouth extension and near microphone, described sound/speech can be distinguished and discern to the sound/speech recognition system better.Another advantage is: by described microphone being positioned adjacent to user's mouth (for example near mouth), the user can be very in a quiet voice to its speak (for example whisper in sb.'s ear).This allows data input almost noiseless and that be interrupted.And another advantage of described microphone is: owing to be integrated in the corresponding electronic device, for described microphone being remained on (for example close user's mouth) on the desired location, the user can have described microphone by he hand-held.Described user also needn't carry the described microphone that separates with described electronic equipment.
In electronic equipment or as the external unit that links to each other with electronic equipment, by following feature is made up: for example, the keypad of enhancing of the present invention, mouse, extendible phone and with the data entry device of for example aforesaid mode can provide the data entry system of complete enhancing.The user can be for example by only using a hand, hold for example electronic equipment of data input device (for example mobile phone, PDA etc.), all features such as the keypad that use for example strengthens, integrated mouse and extendible microphone, and simultaneously by using its natural custom (for example press the button of keypad and speak when needed), provide fast, easily and the input of natural especially data.
One of most important applications of extendible microphone be when the data entry system of mobile communication equipment to the use of keypad and sound/speech recognition system carry out in conjunction with the time.The user carries out alternately (for example, by pushing button) with button by this way, and simultaneously, the user can say for example symbol on described button.In order to press the button that comprises required symbol, the user may need to see keypad.The user also may need the data on the display of the equipment of seeing.On the other hand, the user may would rather say described symbol softly.Extendible microphone allows to make mobile phone to be positioned at from eyes far, enough to see this keypad part, and simultaneously, makes microphone near mouth, allows to speak softly.
Be accustomed to as many people, they can hold their mobile phone in a hand, use the thumb of the same hand to press the button of keypad simultaneously.Second hand can be used for holding around microphone described, to reduce external noise, perhaps makes microphone and mouth keep best relation.
If the microphone of equipment is wireless, perhaps its parts that link to each other with equipment are made by nonrigid material, the user can remain on microphone between two fingers it is positioned at the mode of its palm one side.Then, by the palm of described hand being positioned at around the mouth, the user can reduce external noise significantly when speaking.
The user interface that comprises data input cell and the display that are appreciated that the electronic equipment that uses user's voice input data can be any kinds.For example, this electronic system can comprise touch-sensitive pad (touch sensitive pad), rather than keypad, and perhaps, this electronic equipment can only be equipped with speech recognition system, and does not need keypad.
Figure 18 shows according to embodiments of the invention, for example the electronic equipment 1800 of cell phone or PDA.As shown in the figure, keypad 1801 is positioned at the front of described equipment 1800.The mouse (not shown) is positioned at the back side of described equipment 1800.Extendible microphone 1802 also becomes one with described equipment.Described microphone can extend, and positions (mouth that for example approaches the user) by the user on desired location.Described equipment can also comprise foregoing data entry device.By only using a hand, the user can carry out quick and easy data input with very high accuracy.Described microphone is positioned adjacent to user's mouth, makes and user's sound/speech is discerned better by system.Described user (for example whisper in sb.'s ear) in a quiet voice speaks facing to described microphone.This allows almost noiseless data input.
In the optional embodiment of Figure 18 C, show mobile phone 1800 at Figure 18 B of the present invention with keypad 1801 and display unit.Mobile phone is equipped with has the part 1803 of swaying that is installed in its terminal microphone 1802.By the mouth of microphone to the user extended, the user can speak facing to phone in a quiet voice, and can see the display and the keypad 1801 of its phone simultaneously, and final, when speaking facing to microphone 1802, uses described display and keypad simultaneously.
Figure 18 D shows the extendible microphone 1810 of rotation so that allow the user equipment to be positioned, and simultaneously so that he is concerned easily, by correspondingly rotating and extending microphone, make microphone 1810 near he mouth or reach desired location.Must be noted that the parts that microphone is linked to each other with described equipment can have at least two parts, extend/withdraw each other or to equipment.That microphone can have is folding, slide, flexible and other motions, is used for extending or withdrawal.
Figure 18 E and 18F show the integrated rotation microphone 1820 that telescopically extends.In this embodiment, the extendible part that comprises microphone 1820 can be arranged in equipment.When needs, the user can pull out this part, and its mouth to him is extended.When it was drawn out, microphone 1820 also can be used.
According to an alternative embodiment of the invention shown in Figure 18 G and Figure 18 H, the extension component 1830 that comprises microphone 1831 can be a part of manifold equipment.This part can be as the lid of described equipment.The part self that comprises microphone 1831 can be a plurality of parts so that as required be extendible and/or adjustable.
According to the embodiment shown in Figure 18 I, can be installed in foregoing extendible microphone 1840 in computing machine or the similar devices.
And, according to another embodiment of the invention, can tie the microphone of equipment on user's the ring, perhaps itself be made into the shape that resembles ring, and wear by described user.This microphone can wirelessly or by lead link to each other with described equipment.When using, the user makes its hand also speak near its mouth.
The equipment shown in the figure that is appreciated that is illustrated as an example.Extendible microphone can be installed in any equipment.It can also be installed on any position on the extension.
In communication facilities, comprise that the extension of microphone can be used as the antenna of described equipment.In this case, it is manufactured that antenna can be used as described part, and comprise integrated microphone.
Must be noted that except extendible at least microphone, equipment can comprise the conventional microphone that at least one is other, wherein, described microphone can use separately, also can use simultaneously with described extendible microphone.
Must be noted that, can utilize rigid material to comprise the extendible parts of microphone,, and do not need it to be kept with hand so that allow microphone is positioned at desired location.For operation better, can also comprise the part of microphone by semi-rigid or flexible material manufacturing.
Must be noted that, can use for example any extension/retracting method of expansion/method for folding.
As previously mentioned, integrated keypad of the present invention and/or mouse and/or extendible microphone can be integrated in telepilot and multiple other the various electronic equipment internal of electronic equipment of for example PDA, TV.For example, by described integrated keypad and mouse in the telepilot that uses TV, the user can give directions on the icon relevant with film shown in the TV screen, and selects described film by the predetermined key of using described telepilot.
And, as described, can be fabricated to equipment separately to described integrated keypad and/or mouse and/or extendible microphone, and link to each other with described electronic equipment.
Certainly, can combine with the data and the text entry method of for example data entry device of the present invention independent described keypad or with described keypad that described mouse and/or extendible microphone become one.
Figure 17 shows some electronic equipments of the keypad that can use enhancing of the present invention, the mouse of enhancing, extendible microphone and data entry device.
Electronic equipment can comprise at least one or a plurality of feature of the present invention.Electronic equipment can for example comprise all features of the present invention as described.
Data input by wire telephony
Aforesaid data entry device can also be used for wire telephony and their corresponding network.Road as known, each button of telephone keypad produces pre-tone, and it transmits by cable network.12 pre-tones that have 12 buttons distributing to telephone keypad.By using for example the purpose wire telephony and the keypad thereof that are used for the data input of input text, may there be the needs that produce other tone.Can be the different tone of each allocation of symbols, thereby network will be discerned according to the tone that is produced of distributing to described symbol to symbol.
Be worn over the manifold data input cell on the wrist
Figure 22 a shows the different embodiment of foregoing data input cell 2201-2203 of the present invention as an example.In order to reduce the size of described data input cell, manifold data input cell 2202-2203 can be set, it can have aforesaid manifold keypad 2212-2222.Described manifold data input cell can have part of the present invention and whole feature.This data input cell also has described in this application integrated data entry system.As an example, data input cell 2202 comprises display 2213, antenna 2214 (can be extendible), microphone 2215 (can be extendible), is integrated in the mouse (not shown) of described data input cell back.
Can be on wrist an embodiment band of data input cell of the present invention.Can be integrated in this embodiment in the equipment on the wrist of being worn over of wrist-watch for example, perhaps for example on the wrist strap of watch band.Described data input cell can have the part or all of feature of integrated data input cell of the present invention.This will allow to have the small-sized data input cell of tiing on user's wrist.The described data input cell that is worn on the wrist can be as the data input cell of any electronic equipment.By the data input cell that is worn on its wrist is linked to each other with required electronic equipment, the user for example can open its residence door, carry out alternately with TV, and computing machine carry out alternately, dial the number etc.Identical data input cell can be used for different electronic equipments is operated.For this purpose, can distribute to each electronic equipment to access code (access code).By the access code of input (for example by described data input cell) required electronic equipment, can set up the connection between described data input cell and the described electronic equipment.
Figure 22 b shows the example (being in open mode) that is worn over the data input cell 2290 (the manifold data input cell that for example has manifold keypad 2291) on the wrist of the present invention, this unit link to each other with for example handheld device of PDA 2293 (wirelessly or by lead 2292).Described manifold data input cell 2290 can also comprise additional features, for example described in this application part or all of feature.In this example, display unit 2294, antenna 2295, microphone 2296 and mouse 2297 are set.
Be appreciated that described manifold keypad can pull down from the equipment/wrist strap 2298 that is worn on the wrist.For this purpose, can provide different dismounting/method of tying known to those of skill in the art.For example, shown in Figure 23 a, can be arranged on the shell 2301 that is used to comprise described data input device in the wrist strap 2302.Figure 23 b shows the described shell 2303 that is in open mode.Dismountable data input device 2304 can be arranged on described shell 2301 inside.Figure 23 c shows the described shell that is in open mode 2305 and is in closed condition 2306.When being in open mode (for example when using described data input cell), the part of the parts 2311 of described data input cell (for example part of keypad and/or display etc.) can be positioned at the lid 2312 of described shell.
According to one embodiment of present invention, for example the equipment of watch 2307 can be arranged in the side relative with wrist in the identical wrist strap.For example, the watch band with shell can be set, to contain data input cell.Described watch band for example can be tied watch, wrist and wear any wrists such as camera and wear on the equipment.The shell of data input device can be positioned on wearer's wrist one side 2308, and the shell of described another wrist strap equipment can be positioned on described wearer's the offside 2309 of wrist.On the equipment of described wrist strap being tied wrist strap for example, what traditional watch band watchband can be provided ties device 2310.
Above-mentioned wrist strap shell can also be used to contain any other wrist and wear equipment.For example, except containing data input cell, described wrist strap shell can be suitable for containing the various electronic that wrist is for example worn phone.
Has multiple advantage when using wrist of the present invention to wear data input cell.For example, the user can be placed on electronic equipment in its pocket, and the display unit of described electronic equipment (can be flexible) is placed in its hand.Wear data input cell by described wrist, mutual with described electronic equipment can be provided.In another example, wrist of the present invention is worn data input cell can be used to operate E-News demonstration (about the PCT patented claim No.PCT/US00/29647 that E-News shows, the applying date is on October 27th, 2000, is incorporated in this as a reference).
Therefore, when to as the of the present invention basic novel feature that is applied to optional embodiment illustrates, describes and when pointing out, will be appreciated that, do not deviate from spirit of the present invention, the multiple omission of the form of disclosed invention and details and replacement and variation can produce by those skilled in the art.It being understood that accompanying drawing needn't draw in proportion, but their only actually is notional.For example, can for all buttons be provided with single presser sensor system (for example pressure sensitive pad) (for example on button or below single bigger pad), rather than provide independent pressure system for each button of keypad.The user can also be by not being that the additive method and the button of its finger carries out alternately.For example, described user can use pen to go to push button.
Data entry device of the present invention can also use other data entry device.For example, described symbol can also be distributed to for example other objects of user's finger (or part of finger), rather than allocation of symbols is given the button of keypad.These objects mentioned in this application and data entry device are described in detail among the list of references PCT patented claim No.PCT/US00/29647 that is incorporated into already, and its applying date is on October 27th, 2000.
Extendible display unit
According to one embodiment of present invention, extendible display unit can be set in the electronic equipment of for example data input cell of the present invention or in mobile phone.Figure 24 a shows the extendible display unit 2400 that is in closed condition.This display unit can be made by rigidity and/or semi-rigid material, and can be for example folding or launch or telescopically extend or withdrawal or have its device that extends by any method and withdraw of permission by corresponding hinge 2401.
Figure 24 b shows the mobile computing device 2402 of the mobile phone that for example is in having of open mode described extendible display 2400 of the present invention.When opening, described extendible display unit can have the width of A4 standard paper, thereby utilizes word processor to write letter or during browsing page for example user, the developed width size that allows described user to see file, and work is thereon.
Display unit of the present invention can also be made by flexible material.Figure 25 a shows the flexible display unit 2500 that is in closed condition.
Be appreciated that display unit of the present invention can also be at least a portion of its opposite side (for example the outside) 2505 display message.This is important, because under some situation, the user may wish to use display unit and not launch it.
Figure 25 b shows the electronic equipment 2501 with flexible display unit 2500 of the present invention, and flexible display unit 2500 is in open mode.
By making electronic equipments such as data input cell for example of the present invention, mobile phone, PDA have at least one enhanced features of the present invention, for example comprise the extensible/inextensible display unit of foregoing telecommunication installation, mouse of the present invention, extendible microphone, extendible camera, data entry system of the present invention, speech recognition system or described in this application other any features, can be to being provided with by a user's the hand-held complete data input/computing equipment that has and operate.This is very important, because as well-known, in the input of mobile environment calculating/data, user's at least one hand must be freely.
Extendible camera
As described for extendible microphone, electronic equipment can also be equipped with extendible camera.For example, for having made up that button is pressed and the data entry system of the present invention of labiomaney (be not user's sound/speech, or except user's sound/speech), extendible camera can be set in corresponding electronic device or data input cell.
Figure 26 shows the mobile computing device 2600 that is equipped with the part 2601 of swaying.The described part of swaying can have and is installed in for example its terminal camera 2602 and/or microphone 2603.By camera being stretched to user's mouth, the user can speak to camera, and during using button to press the data input of the present invention that combines with the shape of the mouth as one speaks, camera can transmit for example image of user's the shape of the mouth as one speaks.Simultaneously, the user can see the display and the keypad of its phone, and final when speaking facing to camera, uses described display and keypad.Certainly, the microphone that is installed on the extendible part can transmit user's voice to the speech recognition system of data entry system.
Extendible microphone of the present invention and/or camera can removably be tied on the electronic equipment of mobile phone for example or PDA.This is that the manufacturer of electronic equipment (for example mobile phone) does not wish to revise its hardware for new application because under many circumstances.
According to one embodiment of present invention, comprise that the part of swaying in the outside of microphone and/or camera can be the unit of removably tiing on the corresponding electronic device that separates.Figure 27 shows the dismountable unit 2701 that is in disassembled state and the electronic equipment 2700 of for example mobile phone.Dismountable unit 2701 can comprise one of a plurality of assemblies, includes but not limited to microphone 2702, camera 2703, loudspeaker 2704, optical reader (reader) (not shown) or is necessary that close user is so that carry out other mutual assemblies with electronic equipment better.This unit further comprises at least one antenna, or itself is antenna.This unit further comprises ties and/or coupling arrangement 2705, so that unit 2701 is tied on the electronic equipment 2700, and assembly available on the unit 2701 is linked to each other with electronic equipment 2700.In order to tie and purpose of connecting, tie with coupling arrangement 2705 and can be suitable for using port 2706 available in the electronic equipment of for example mobile phone 2700 or computing machine, port is set, is used for for example connection of the peripheral assembly of microphone, loudspeaker, camera, antenna etc.Be appreciated that port 2706 can be for example microphone jack or USB port or in electronic equipment the standard port of any other available similar coupling arrangement.In this case, tie/coupling arrangement can be a device for coupling modules for example, it inserts available corresponding port in electronic equipment.
Being appreciated that to provide tiing and/or coupling arrangement of external unit, tie function or electricity/electronics linkage function so that have machinery, or the both has.Shown in Figure 27 a, for example, external unit 2701 can comprise the contact pin 2705 that is fixedly located on the external unit, is used for mechanically external unit being tied electronic equipment.Contact pin also can electricity consumption/electronics mode available microphone assembly 2702 in unit 2701 is linked to each other with the electronic equipment that illustrates previously.Except contact pin, external unit can comprise for example another connector 2707 of USB connector, and it is connected to the camera 2703 that for example is installed in the external unit 2701 by lead 2708.In this case, connector 2707 can be only with electricity/mode of electronics is connected to electronic equipment to unit 2701.
For better machinery is tied, can use port more than one by tiing of external unit and coupling arrangement.For example, tie with coupling arrangement and can comprise that two are tied device, for example fixing two contact pins that are positioned on the external unit, wherein first contact pin inserts first port corresponding to the electronic equipment of for example external microphone, and second contact pin inserts the port corresponding to for example external loudspeaker.
Figure 27 b shows and is tiing the of the present invention dismountable external unit 2701 and the electronic equipment 2700 of position.
After external unit 2701 is tied electronic equipment 2700 (for example by contact pin 2705 is inserted corresponding ports 2706), the user can adjust external unit 2701 in required direction by in this application to the foregoing extension and the rotational action of extendible microphone and camera.Must be noted that once more, dismountable unit of the present invention can have be similar to foregoing in this application to the characteristic of the extendable portion of the present invention that is used for external microphone and camera.For example, dismountable unit 2701 of the present invention can be have at least two parts 2710-2711 manifold, and wherein each part has each other and for the action of for example the swaying, rotate and extend of external unit (flexible, folded).Can use and tie part 2712-2714 and be used for these purposes.
Dismountable unit as described allows to add outside/peripheral assembly to electronic equipment and use them, is parts of original equipment as them.It at first allows to use the unit, and handle component is not held in the hand or it is tied on user's the health (for example must tie the earphone on user's the ear), and secondly, it allows handle component to add to electronic equipment, and their hardware is revised by the manufacturer of (for example mobile phone) and do not force electronic equipment.
Data entry device of the present invention also can use other data input devices.For example, not the button of allocation of symbols, but can give for example other objects of user's finger (or part of finger) described allocation of symbols to keypad.Equally, system can press with button by the shape of the mouth as one speaks of reading (discerning its action) user and combine/not combination, rather than (or except) the sound/speech input, input is discerned to data.The user can press the button of keypad and tell required letter in the symbol on the described button.The shape of the mouth as one speaks action of telling the user of described letter by identification is pressed with described button and is combined, and system can easily discern and import required letter.
Similarly, as described above, the example that provides in the described in this application collocation method is illustrated as an example.Data input cell as required can be considered the multiple different configuration and the distribution of symbol.Principle in this collocation method is according to different symbols such as different factor definition such as for example frequency of utilization, natural pronunciation, non-natural pronunciation etc., and it is distributed, thereby has distributed its priority level.The group of highest priority grade (sounding or not sounding) is distributed to easy and the most natural button mutual (for example single depression).This group also comprises the non-spoken symbol of highest level.Then, second highest priority is distributed to second easier mutual (for example pushing for twice) etc.
Continue with reference to foregoing data entry system, can produce for the button of keypad with this form, that is, strengthen identification more by sound/speech or the shape of the mouth as one speaks read-out system allocation of symbols.Figure 28 shows keypad 2800, wherein, having the button of distributing to described keypad near the letter character of pronunciation, that is, avoids the ambiguity between them by this way.As shown, separate and be placed on the different key having near the letter " c " of pronunciation and " d ", " j " and " k ", " m " and " n ", " v " and " t ".This will help sound recognition system more easily to discern described letter.For example, in order to select letter " c ", the user can push button 2801 and say " c ".In order to select letter " d ", the user can push button 2802 and say " d ".For example " b " that have near pronunciation also distributed to different buttons with " p ", " t " and other letters of " d ", " f " and " s ".
The built-in speech recognition system that is used for mini-plant is distributed into the least possible storer of use.Separately have the symbol of similar pronunciation and they are distributed to different buttons simplified recognizer significantly, cause the use of storer still less.
Continuation is with reference to Figure 28, and as shown, the configuration of letter is configured to this mode, that is, keep alphabetical a-z be in continuous order (a for example, b, c......z).Carry out symbol configuration on the keypad 2800 in the mode of the telephong type keypad that is similar to standard as far as possible.Be appreciated that when needs and can change this order.
Equally, separating the symbol that the similar shape of the mouth as one speaks expresses can help the shape of the mouth as one speaks (Mouth-Shape Recognition) system of reading more easily to discern them.For example, letter " j " is distributed to different buttons with " k " and will simplify their identification significantly.
Be appreciated that in order for example to discern the spoken symbol of letter, can offer Mouth-Shape Recognition/read-out system more than an image in the different time user's who says described letter the shape of the mouth as one speaks.
The shape of the mouth as one speaks of the present invention (identification) system of reading can use any image that is used for identifying purpose to produce and the image recognition processing technology.For example, as mentioned above, when described user is for example saying the symbol of letter and just pressing button corresponding to described symbol on keypad, can use camera to receive user's mouth shape image.Also can use other images to produce and/or the image interception technology.For example, when the user is for example saying the symbol of letter and press button corresponding to described symbol on keypad, for example the projector of the mode of light or ripple and receiver can be used to described mode is projected on user's the shape of the mouth as one speaks (and finally being on the face), and receive back the described mode of the digital picture (and finally be user's face) of the shape of the mouth as one speaks that the user is provided, and do not use camera.
Press and the data entry system of the present invention of user behavior (for example, voice) can use different behavior (for example, voice) recognition technology in conjunction with button.For example, except the action of the shape of the mouth as one speaks,, can also user's the depress action of tongue on user's tooth be detected for the better recognition voice.
According to one embodiment of present invention, as shown in figure 29, shape of the mouth as one speaks read-out system of the present invention can use tooth and/or the contact on the lip/presser sensor assembly 2900 that movably is installed in the user, and do not use (or except) camera.Described assembly can have and is distributed in its surperficial sensor 2903, is used to detect the action of depressing on its any part, allows the size of colliding between user's tongue and the described assembly, position, pressure survey etc. are measured.Described assembly can have two parts.First 2901 is positioned between two lips (upper lip and lower lip) of described user, and second portion 2902 is positioned at (preferred, as to be the front of going up tooth) on user's the tooth.Tiing device 2904 allows described assembly is tied/is fixed on user's the tooth.
Figure 29 a shows foregoing sensing assembly 2910, be installed in by this way on user's the tooth 2919, that is, the part 2911 of assembly is at (it is outer that in the figure, assembly, user's tooth and tongue are illustrated in user's health) on the described user between the lower lip.Described user can press the button 2913 of the keypad 2918 that comprises letter " abc ", and says letter " b ".By saying " b ", user's lip 2914-2915 depresses the described sensing part 2911 between the lip.Not needing lip to push mutually because say two other letters (for example letter " ab "), is letter " b " so system identification goes out required letter.If the user pushes button 2913 and send the sound of letter " c ", then user's tongue 2916 will slightly be pushed the inside part 2912 of dental part of the assembly of the last front flank that is positioned at the user.Because other letters on the described button (for example " bc ") do not need the described push on the described part of assembly, be letter " c " so system will identify required symbol.If the user pushes button 2913 and say letter " a ", then there is not push to be applied on the described assembly.Then system identification go out required letter be the letter " a ".In another example, if the user pushes button 2917 and say letter " j ", the then upper inner of the dental part of user's tongue press component.If the user pushes button 2917 and say letter " I ", user's the tongue whole inside part of the dental part of press component almost then.In this case, the almost whole sensor of inside part that is distributed in the dental part of assembly will be pressed, and system identification to go out required letter be letter " I ".
The above-mentioned shape of the mouth as one speaks reads/and recognition system allows to have the interruption and the active data input method of pin-point accuracy.This data entry system particularly is used in the department of for example army, public security organ or intelligence agency.
Be according to one embodiment of present invention below, import the example of recognition system by the letter of telephong type keypad:
| The ABC button | |||
| A | B | C | |
| Do not press | Lip partly is pressed | The upper inner part of dental part is slightly pressed | |
| The DEF button | |||
| D | E | F | |
| The whole inboard of dental part is pressed | Do not press | Lip partly is pressed | |
| The GHI button | |||
| G | H | I | |
| The upper inner part of dental part is by heavier pressing | The upper inner of the part of dental part is slightly pressed | Do not press | |
| The JKL button | |||
| J | K | L | |
| The upper inner part of dental part is slightly pressed | Do not press | The whole inboard of dental part is pressed | |
| The MNO button | |||
| M | N | O | |
| Lip partly is pressed | The whole inboard of dental part is pressed | Do not press | |
| The PQRS button | |||
| P | Q | R | S |
| Lip partly is pressed | Lip partly be pressed (in the side) | Do not press | The upper inner part quilt of dental part |
| Slightly press | |||
| The TUV button | |||
| T | U | V | |
| The whole inboard of dental part is pressed | Lip partly be pressed (in the side) | Lip partly is pressed | |
| The WXYZ button | |||
| W | X | Y | Z (zee) |
| Lip partly is pressed | The upper inner of dental part partly is pressed | Do not press | The whole inside part of tooth is pressed |
Must be noted that above table only is illustrated as an example, to illustrate by saying required letter (when using described hardware) and pressing corresponding key zone malapropism mother's convenience.Should be appreciated that, other according to this system for example based on other identification parameters of the compressing time on the hardware of this system (for example when saying " g " or saying " h ", the both on same button and may have similarly press degree) can consider by recognition system and those skilled in the art.Equally, for example say other symbols of numeral (for example 0-9) by the user and it is discerned and can be considered by said system.
In addition, sensing assembly of the present invention can wirelessly or by lead be connected to treatment facility (for example cellular phone).If by wireless connections, assembly can comprise forwarder, is used for transmitting the information of pressing.Assembly can also comprise battery supply, is used to its function that power supply is provided.
As mentioned above, the present invention presses and voice in conjunction with button, is used to improve recognition accuracy.In one embodiment, grammer does not carry out work, is used to allow the letter to only pressing corresponding to button to discern.
Usually, during data (for example text) input by sound/speech, microphone/sensor (transducer) perception user's sound/speech, and its processor that is sent to required electronic equipment, be used for discerning processing by the sound/speech recognition system.For carry out the huge obstacle (particularly, in mobile environment) of effective voice by the sound/speech recognition system to the conversion of data/text, be that the audio quality of input is relatively poor, described relatively poor quality is caused by external noise.Must be noted that microphone indiscriminate " listening " everything.
The researchist has carried out many effort, is used for from required audio frequency difference and elimination external noise.Up to now, these effort can only partly reduce external noise, but still will do extensive work, to obtain acceptable result.Unfortunately, present noise eliminating/minimizing technology has also reduced the quality of required audio frequency simultaneously, makes described audio frequency be not suitable for being discerned by the sound/speech recognition system.
In order during data input electronic equipment, to reduce (or even eliminating fully) external noise by the sound/speech input, and do not reduce the quality that described sound/speech is imported, the microphone/sensor unit that combines with ear that is positioned at user's ear can be provided.Even the user whispers or whispers, described microphone/sensor also can allow user's the better quality of reception of sound/speech.
As everyone knows, when people speak, cause and vibration is transmitted to ear corresponding to the bone of described voice, in inner ear and auricle, cause air vibration corresponding to described voice by described voice.
According to a kind of method, by the described air vibration of microphone perception that combines with ear that is arranged in ear, preferred, microphone is in auricle.According to another kind of method, the vibration of described otica himself can be by being positioned at sensor that Er Nei combines with ear from the inner ear perception.
Figure 30 shows microphone/sensor unit 3000, and it is designed to be in this mode, that is, the mode that is positioned at user's ear (preferred, as to be user's auricle) with microphone/sensor module 3001 combines with user's ear.
Preferably, except microphone/sensor module 3001, described unit 3000 can also have the spacer assembly 3002 of sealing, wherein, it is (preferred when described microphone 3001 is installed in user's the ear, in user's auricle), described seal separating device 3002 can be kept apart described microphone from outside (ear) environmental noise, to allow the user's that 3001 perception of described microphone form sound/speech in ear.For the sound/speech recognition system is that the external noise of subject matter will reduce significantly or even will eliminate fully.
The user can adjust the degree of seal isolation as required.For example, for the voice echo in the cancellation auricle, can by from described user's auricle slight extract described microphone unit, described microphone is from the less isolation of external ear environment.Microphone unit also has the degree of isolation device of the isolation that becomes one/not.
Can be connected to corresponding electronic device to described microphone/sensor 3001 by lead 3003 or by wireless communication system.Wireless communication system can be for example bluetooth, infrared, radio frequency any kinds such as (RF).
Sound/speech-to-data (for example text) input system use combine that button is pressed and corresponding voice, now be named as button-and-data entry system of the present invention of (KIKS) technology of speaking during, the above-mentioned microphone/sensor that combines with ear can be used for perception user's sound/speech.By pushing button and saying the required symbol of distributing to described button (for example letter), as mentioned above, the sound/speech recognition system is made great efforts described voice match to one of speech pattern of several symbols of distributing to described button.In this case, even the microphone/sensor that combines with ear has than the low-qualityer audio frequency perception of standard microphone, will still be enough to make the sound/speech recognition system in the above several symbol of this button, easily to discern spoken symbol by the quality of the spoken symbol of the described microphone/sensor senses that combines with ear.
According to one embodiment of present invention, as shown in figure 31, can provide the microphone 3100 that combines with ear, and it is connected to for example mobile electronic device of mobile phone 3102.As shown in the figure, design microphone 3101 in the following manner, that is, it is positioned at user's auricle, and when described user spoke, perception was carried out in the vibration of the user's who produces in the ear to the user sound/speech.Then, by lead 3103 or wirelessly described voice are sent to described mobile phone 3102.
By in the ear that is positioned in the user and have a seal separating device 3104, described microphone 3101 sound/speech with a perception user.To the sound/speech recognition system is that the external noise of subject matter will reduce significantly or even eliminates fully.As mentioned above, can adjust degree of isolation automatically or by the user.
For example, when the user pushes button 3105 and when saying the letter " k " that is positioned on this button, the vibration of described voice in user's ear can be carried out perception by the described sensor/microphone that combines with ear, and is sent to required electronic equipment.Sound/speech recognition system of the present invention must be mated described voice and the speech pattern of having stored that is positioned at several symbols on the described button (for example, in this example, " J, K, L, 5 ").Even the quality of described voice good inadequately (for example, because the user mumbles), described voice can be are easily mated with the memory module of required letter.
As what just mentioned, another advantage of native system is that the user can mumble or even whisper in sb.'s ear.Because on the one hand, microphone is installed in user's the ear, and directly the perception user sound and do not interrupted by external noise, and on the other hand, even the user mumbles, whispers, recognition system still makes great efforts spoken symbol and only several selection are mated, so, user's sound quality will be still enough good, use for the sound/speech recognition system.Because identical reason, recognition system can be independent of the user.Certainly, utilize user's sound to train (for example loudspeaker relies on (dependent) method) will more make recognition system have the better recognition accuracy grade to system.
Except microphone/sensor, the unit that combines with ear also comprises the loudspeaker that is positioned at microphone/sensor outside, and its ear same and user becomes one the purpose that is used to listen to.
According to one embodiment of present invention, shown in figure 32, first ear (as mentioned above) that is installed in the user with microphone 3201 is gone up and loudspeaker 3202 is installed in mode on second ear of user, and the microphone and the loudspeaker 3200 that combine with ear can be provided.
Above-mentioned explanation should not be construed to limiting the scope of the invention, and has only described preferred embodiments more of the present invention.Many variations can be considered within the scope of the present invention.For example, in the example of the unit that combines with ear of Figure 32, can offer two ears to microphone and loudspeaker assembly.In another embodiment, when the described unit wireless that combines with ear is connected to corresponding electronic device, in described and unit that ear combines, can provide battery supply.Equally, in order to obtain the better voice quality of reception, the microphone unit that combines with ear of the present invention comprises that also at least one is positioned at other standard microphone of ear outer (for example on conveyer line).Microphone in the ear combines and can provide more audio signal information for sound/speech recognition system of the present invention with ear microphone outward.Must be noted that also data entry system of the present invention can use microphone or the sensor that utilizes any technology, be used to receive the speech fluctuations in the ear.
As mentioned above, the general data input method of button being pressed with voice combine (for example according to user's voice or shape of the mouth as one speaks action) is described in PCT application PCT/US00/29647, and the applying date is on October 27th, 2000.
As described in described in the application, by pushing button and saying or do not say required symbol, for example distribute to the character in the symbols of described button, can select described required symbol.For example, for by standard telephone type keypad 3300 input words " morning " (referring to Figure 33), the user can:
-push button 3308 and say ' m ';
-push button 3308 and say ' o ';
-push button 3306 and say ' r ';
-push button 3308 and say ' n ';
-push button 3303 and say ' i ';
-push button 3308 and say ' n ';
-push button 3303 and say ' g '.
Say word by letter-by-letter (or by symbol), and press corresponding button, can import described word.
The keyboard (for example telephone keypad) that the data entry system of describing in PCT/US00/29647 can allow to have the number of keys of minimizing plays the effect (for example, symbol corresponding a kind of press action) of full-scale PC keyboard.
By the word data entry system
In order to strengthen above-mentioned data entry system, a kind of data entry system of word level is suggested in described PCT application.In described application, to making the user can import word to be described by saying described word and pressing button corresponding to the letter that constitutes described word.
In language, the voice of each word can be made of phone set, and wherein, described phone set comprises one or more phonemes.Figure 34 shows the example of word lexicon 3400, wherein, for each input (for example word) 3401, its character set (for example its corresponding character string) 3402, relevant button value of pressing 3403 (for example, using telephone keypad for example shown in Figure 33), be illustrated corresponding to the speech model 3405 (finally by the use of sound/speech recognition system) of the phone set 3404 and the described phone set of described word.
Method according to a kind of sound (for example voice) identification when the user says word, can compare the speech model of his voice and storage, and will select one or more optimum matching patterns by system.According to the method for another kind of speech recognition, for example, when the user says word,, its voice are discerned based on the identification of the phone set that constitutes described voice.
Then, selected corresponding to the word (for example character set) of described selected speech model or phone set by system.If select to comprise a word, then described word can become final selection.If select to comprise, then can be shown to user's (for example in tabulation that display demonstrates) to described word, and the user can select to one of them by for example pressing " select " button more than a word.
Said method based on the word identification of word pronunciation only is described as an example.Be appreciated that by those skilled in the art and can consider the additive method discerned by voice.
Only word is discerned and be not system accurately based on its voice.This is existed a plurality of reasons.For example, many words have roughly similar or indistinct pronunciation.Equally, for example the factor of external noise can cause ambiguity in the word level data entry system.Import the complicated software of word needs arbitrarily by sound, need consider the multiple parameter of for example accent, sound distortion, user's purpose or noise effect.Owing to these reasons, speech recognition system is based on the identification of phrase, wherein, for example, can eliminate according to the context of the described phrase ambiguity to word with similar pronunciation in phrase.Speech recognition system based on the identification of phrase needs a large amount of storeies and CPU to use equally, and so far, this can not be integrated in the skinny device of mobile phone for example them.
Can address the above problem by the inventor button and voice technology invention and that in different PCT and U.S. Patent application, be described.Except/in conjunction with as described in the character of the character input system described in the application, word level data input technology of the present invention can for the user provide have nature fast (by word) text/data entry system small-sized/move/fixed equipment.
As described, in PCT application PCT/US00/29647, and described the user and said word, pressed button simultaneously corresponding to the letter that constitutes described word.Also mention, can use the word lexicon database for this purpose.According to these and with reference to Figure 33, as example, when the user said word " card " and press corresponding button (for example button 3302,3302,3306,3309 of telephong type keypad), the word pressed corresponding to described button can be selected from dictionary database (database for example shown in Figure 34) by system.In this embodiment, the phase pressed of button is on the same group also corresponding to for example other words of " care ", " bare ", " base ", " cape " and " case ".Then, system can compare the voice (memory model or phone set) of user's voice (this word) with the described word of pressing corresponding to same key, and if one of them and described user's voice are complementary, then described word is selected by system.If described word does not have voice and user's voice to be complementary, system can be in described word so, the word (or a plurality of word) of selecting its voice and described user's voice to mate most.
According to this method, recognition system will be selected word from only several candidates (for example, being 6 words in the above example).As a result of, identification becomes easily, and the accuracy of speech recognition system is when significantly improving, and this allows to carry out with pin-point accuracy text input of general word level.Must be noted that equally saying that word imports it simultaneously is the behavior that people are familiar with.
According to a further embodiment of the invention, in order to import word, the user can press several (for example, two corresponding at least a portion character of described word, and if desired, more a plurality of) button, (preferred, begin) and (preferred, simultaneously) say described word.Press and described voice according to described button, system can discern required word.For this purpose, according to a kind of method, for example, the word of dictionary database can at first be selected by system, and wherein, the corresponding part character of described word is pressed corresponding to described button, and the voice and the user's voice of described selected word compared.Then, one or more words are selected by this system, and wherein, their voice mate described user's voice most.Press according to several at least buttons, the word in the dictionary that is present in word database is selected, the significant quantity that reduces the described selection word that compares with user's voice corresponding to the beginning character at least of described word.This makes the pin-point accuracy of the required word of input become possibility.According to another kind of method, for example, system can at first select its voice to mate the word of the dictionary of described user's voice most.Then, system can press beginning character at least to described word (constituting the character set of described word) by described user's corresponding button and determine (determining which button they belong to and press), so that final the selection pressed the character set that is complementary with described user's button.
In the above-described embodiments, if select to comprise a word, then described word can become final selection.If select to comprise word more than one, then described word is shown to user's (for example in tabulation that display shows), the user can select they one of them by for example pressing " select " button.Be appreciated that the system of pressing the input word of corresponding word being selected with the combination of voice and by the system just described by button is illustrated as an example.Clearly, for identical purpose, by it will be appreciated by those skilled in the art that and considering other system based on the principle of data entry system of the present invention.
Say word and press button, and described button pressed and press the said method that compares corresponding to the button of the letter of word in the word lexicon and need use a large amount of storeies corresponding to the character of at least a portion that constitutes described word.Stored the phone set/voice of all available words (for example pattern) in the language, corresponding to the database of the character string of described word available in one or more language and have the database of pressing corresponding to the button of described word available in described dictionary database, need a large amount of storeies.
Equally, described in former application, according to data entry system of the present invention, for example the symbol of punctuation mark can be distributed to the button of keypad, and does not say voice, the input of giving tacit consent to by pressing described button.In word level data entry system of the present invention as the aforementioned, the user can finish this word before all corresponding buttons of word of input are pressed end.May not be considered to described default character owing to do not pressed by the last button that user's voice covered, this may make the recognition system fascination.Exist many solutions to overcome this problem.For example, the user can at first say word, and then presses corresponding button.This will point out to system, can produce after voice corresponding to a series of buttons of described voice and press.
In another example, by for example pressing the predetermined action of mode key, system can withdraw from Text Mode and enter for example another kind of pattern of punctuate/function mode (for example special character pattern).According to this example, in described Text Mode, when corresponding to last voice, system can consider that all buttons press.When system is in the special character pattern, by pushing button, can import for example symbol of punctuation mark, equally the end of pointing out described word to system at the end (or any other position) of word.
As described in explain in the PCT application, can distribute at least one special symbol of for example punctuation mark, space character or function the button of keypad.Press the button of described keypad and silent by single, import for example symbol of punctuation mark by described button.On identical button, press for two times and silently can provide another symbol of distributing to described button (for example punctuation mark).
Data entry system based on sub-voice (sub-speeches)
Must consider, when saying word, the user presses simultaneously when it is imported, the client is divided into one or more sub-phonological components (for example, when the letter of client's input corresponding to each sub-voice) to the described voice of described word according to the syllable of for example described voice very naturally.For example, when using the keyboard input word " morning " of keypad for example, the user can at first say first sub-voice " mor " very naturally, and/it presses corresponding button simultaneously.Then, the user can send the sound of sub-voice " ning " subsequently, and knocks corresponding button.Illustrate for convenience, in this application, word " sub-voice " is used to indicate a part of voice of the voice of word.For example, can say word " perhaps " with two sub-voice " per " and " haps ".Also for example, say word " pet " with single sub-voice " pet ".
Also for example, in order to import word " playing ", when the user imports corresponding to the button of letter " pla ", can at first send sound corresponding to the phoneme of first syllable (for example " ple "), and then, when input character collection " ying ", send sound corresponding to the phoneme of second syllable (for example " ying ").
Must be noted that, user may word be divided into another user different part.Therefore, to press for each part with corresponding button may be different to sub-voice.After all partial data of finishing described word by described user (for example button is pressed and sub-voice) input, net result will be similar.
In above-mentioned example, described another user may send the sound as the first of " pla ", and presses the button of corresponding character set " play ".Then, he can say " ing ", and presses the button corresponding to character string " ing ".Also for example, third party can be pressed by 3 sub-voice sequences and button word " playing " is imported.When knocking corresponding button, described user can say " ple ", " yin " and " g " (for example, spelling character " g " or send corresponding sound).Be appreciated that the natural way that the different sequences pressed with voice and button are divided word is the syllable of each voice sequence corresponding to described word.Therefore, must be noted that even in many paragraphs of the application, also a part/joint of syllable as word, data entry system of the present invention can be applied to divide with one or more parts any form of word for we.
According to above-mentioned principle, for example, can send the sound of word " trying " by two parts (for example syllable) " tri " and " ing ".Also for example, can divide word " playground ", and (for example with two parts, according to its two syllables) " pla " and " ground " (for example import, in many paragraphs of the application, phoneme (for example speech sound) is illustrated by the corresponding character according to Webster (Webster ' s) dictionary).
As superincumbent example was shown, in a kind of (or multiple) language, the part voice of various words can have similar pronunciation (for example being made up of identical phone set).For example, word " trying " and " playing " have common sub-phonological component " ing " (or " ying ") in their voice.
According to above-mentioned principle, can produce a kind of data entry device, wherein, by the predetermined phoneme/speech pattern collection corresponding to the sub-voice of word is considered/is write down and at least a portion of pressing corresponding to the button of the character set (character-set) of distributing to corresponding phoneme/speech pattern collection is considered, of the present invention press and the data entry system of speaking in the identification of whole word can become effectively.Figure 35 shows the exemplary dictionary 3501 corresponding to the phone set of the sub-voice of whole word lexicon 3502 (for example collection of phoneme), with dictionary 3503 corresponding to the character set of the phone set of described phone set dictionary 3501, comprise that also the dictionary 3503 of character set is corresponding to the dictionary 3501 of described phone set corresponding to the dictionary (according to telephone keypad) 3504 of button value of pressing of the dictionary 3503 of described character set.According to different embodiment of the present invention, can use one or more these databases by data entry system of the present invention.
Because in many cases, identical phone set (or sub-speech pattern) can be used to discern different word (having identical sub-sound pronunciation in their voice), phone set/the speech pattern of storage still less is required and is used to be identified in available whole word in one or more word lexicon, has reduced required memory span.This will cause the phone set/character set that reduces quantity is distributed to for example corresponding button of the keyboard of telephong type keypad, and will improve the accuracy of speech recognition system (for example arbitrary text input) significantly.
Figure 36 shows the illustrative example of the English word 3601 with similar phonological component 3602.As shown in the figure, four short phone set 3602 can produce the voice of at least seven whole-word 3601.Be appreciated that described phone set 3602 also can represent the part voice of many other words in English or other language.
Based on above-mentioned principle, can provide nature to press and voice data entry system, the mobile device of the button (for example telephone keypad) of this system by having limited memory capacity (for example mobile phone, PDA) and limited quantity uses the phone set that reduces quantity to import any word (for example normal commands, arbitrary text input).This system can also be by for example being used for for example PC keyboard of the fixed equipment of personal computer, and input strengthens to data.In this case, (because the PC keyboard has more button) still distributes to each button to the phone set that reduces quantity, improves the accuracy of speech recognition system.Different specific embodiment of the present invention will be described in the back.
All buttons-to the small part phoneme
According to one embodiment of present invention, the user can be divided into different sub-voice to the voice of word, and wherein each sub-voice can be by representing that corresponding to the phone set of character string (for example character set) this character string constitutes the appropriate section of described word.By say each phone set and/press simultaneously corresponding to the button of letter and to all (or to small part) described sub-voice and repeat (in order, this process from start to finish), can import the described whole word form of character string (for example with), wherein said letter is corresponding to described phone set/character set.
As shown in figure 33, for example, letter " t " is positioned on the button 3301 of keypad 3300.For described button, can distribute phone set that for example " t e ", " ti ", " ta ", " to " etc. are different (in this embodiment, described phone set is corresponding to the character set with described letter " t " beginning), and/or corresponding speech pattern (referring to the form of Figure 37).The sound that sends " t e " can be corresponding to for example " tea ", " tee " or even the different letter collection of " the " (for example, if the user is not the U.S./Britain native).As an example, in order to produce word " teabag ", the user can press " t " button 3301 and say " t e ", and continues to press the residue button corresponding to remaining letter " ea ".According to a kind of method, system can compare user's voice and voice (for example pattern) or the phone set of distributing to the button of at first pressing (" t " button 3301 in this example).After described user's voice and (or a plurality of) described phone set/speech pattern distributing to described button were mated, one or more character set of distributing to described phone set/speech pattern were selected by system.As mentioned above, in this embodiment, identical voice can be corresponding to two different character set, and one corresponding to letter " tea " (for example the button value of pressing 832), and another is corresponding to alphabetical " tee " (for example the button value of pressing 833).System to the button (for example key value) pressed by the user with press (for example key value) corresponding to the button of selected character set and compare, and, if they one of them and user key-press press and be complementary, then system is selected it, so that finally carry out I/O.In this embodiment, letter " tea " can be the final selection in this stage.For example terminal point (for example end of the word) signal pressed of space button can reporting system: for current whole-word, button is pressed with voice and is finished.
Must be noted that preferred, the phone set (for example " tak ") of expression character string (for example tac) can be distributed to the same key of another phoneme (for example " t "), represents that first character (for example " t ") of described character string is assigned with.Equally, preferably, by alphabetic string (for example " th ") expression and represent that the single phoneme (for example " th ") of character string (for example " th ") can distribute to the same key of another phoneme (for example " t "), represent that first character (for example " t ") of described character string is assigned with.
In above-mentioned example, described selection is not final (for example, so the user does not provide described terminal point).The user can press corresponding to letter " b " () button 3302 and say " bag " for example, first character of back syllable in word, and continue to press residue button corresponding to residue letter " ag ".Handle above system resembles, and select corresponding character set " bag ".Now, the user is by for example pressing the signal that space bar provides the word end.
By saying " t e " and pushing button 3301,3309,3302 (for example key value " 8,3,1 "), and then say " bag " and 3302,3302,3303 (for example key value " 1; 1,4 ") that push button, can produce word " teabag ".Arrive as noted, press by voice and button and produce word " teabag ", and in storer, do not have complete speech pattern/phone set.In fact, speech pattern/the phone set of word " teabag " produces by two other sub-speech pattern/phone set (for example " t e " and " bag ") available in storer, the part of the described phoneme pattern/phone set of each expression whole-word " teabag ", and produce described complete speech pattern/phone set together.Can use speech pattern/phone set of " t e " or " bag ", respectively as for example part speech pattern/phone set of other words of " teaming " or " Baggage ".
Though in this embodiment, recognition accuracy is very high, and it is wrong word that final sometimes selection also may take place, and it is non-existent situation in dictionary database.Because this reason, according to one embodiment of present invention, before the described word of I/O, system can compare the word of the word lexicon of final selection and required language.If the word in described selection and the described dictionary does not match, can refuse this selection.
Equally, according to a kind of method, when the corresponding button of the part of pressing word and when saying it, in described input, the user covers the mode that corresponding button presses with his voice and says this word.This will have the following advantages, that is, each constantly user's voice corresponding to the button that is pressed simultaneously, thereby make the identification of described voice easier.On the other hand, at the end of word input, the user can press any button and silent.This can reporting system, and word has intactly been imported (for example, push button and silent can be assigned to for example character of punctuation mark, PC function etc.).This situation explained in the PCT application that this PCT application was submitted to by the inventor.
After above-mentioned identifying is finished, according to an embodiment, if selected output comprises the word more than, then can be shown to user's (for example in tabulation that display shows) to described word, and the user can one of them be selected to them by for example pressing " select " button.
Must be noted that, in some cases, of the present invention press and the data entry system of speaking in, to the one or more sub-voice of word (preferred, described sub-voice begin to locate those) the part phoneme discern and may be enough to discern corresponding word.
According to one embodiment of present invention, do not consider all phonemes corresponding to the sub-voice of word, and can only consider that several phonemes are (preferred, those that described sub-voice begin), and it is preferred, it is distributed to button corresponding to the initial of character set, and this character set is corresponding to described phone set.By the data entry system of pressing and speak of the present invention, described phone set can be used as identifying purpose.According to this method, can reduce the quantity that is used to discern the needed speech pattern/phone set of many whole-word significantly.In this case, each button for the keyboard of for example keypad will distribute only several phone set by the sound/speech recognition system, thereby make the identification of described phone set easier.
By using speech recognition system, for each sub-voice of word (preferred, first sub-voice) all/several are (preferred, beginning) character determines, together with consideration, by the word of data entry system of the present invention in can identifiable language to pressing corresponding to all buttons of all characters of described word.
As mentioned above, preferred, according to the sub-voice of word in the language, can consider and store different phone set (or speech pattern).Each described phone set can be corresponding to the part of the word of any position in described word.Each described phone set can be corresponding to having similarly/roughly similarly one or more character set of pronunciation (for example string).According to first character of their corresponding character set, described phone set is distributed to button.For example, the phone set " t e " of expression character set " tee " and " tea " can be assigned to button 3301, and phone set " t e " is also represented letter " t ".If phone set is represented each two character string with different letter beginnings, then can distribute to two different buttons to described phone set, each button is represented the initial of one of described character string.For example, in order to strengthen the accuracy of sound recognition system of the present invention, can distribute to phone set " and " to the character set with roughly similar pronunciation " and " and " hand ".In this case, can distribute to expression letter " a " and " h " two different buttons 3302 and 3303 respectively to described phone set.Be appreciated that preferred, corresponding character set will be " and " when pushing button 3302 and when saying " hand ", and when pushing button 3303 and when saying " hand ", preferred, corresponding character set will be " hand ".
Figure 37 shows the example table that may appear at some phone set of locating with the beginning (or other any positions) of syllable of the word of letter " t " beginning.Last column of form also shows for the phone set of letter " i " and other examples of relevant character collection.
Though can consider, simulation, the phone set that has a multitone element more with storage (for example, taps for example, t ake, longer phone set such as t ast), so that help the identification of word, in the present embodiment, wherein, the user roughly presses all buttons corresponding to the letter of word, by discerning in conjunction with sound/speech and use word database and relevant database (for example button value of pressing) as shown in figure 35, determine/discern the minority beginning character of the one or more parts of described word (for example syllable), may be enough to produce described word.Clearly, when needs,, also use longer phone set in order to discern and eliminate ambiguity better.
For example, by considering Figure 33 and use the form of Figure 37 that in order to produce word " title ", the user can press corresponding to the button 3301 of letter " t " and say " ti ", and then presses the residue button corresponding to residue letter " itle ".At the end of word, the user can press for example word end key of space bar.Form is shown as described, and for example character set of " ti, ty, tie " is distributed to phone set " ti ".Clearly, first letter " t " is selected.3303 (for example, " y " is on buttons 3304) because push button, second letter will be " i ".Next the button of pressing is and letter " t " relevant button 3301.In this case, the possibility of character keys " tie " is excluded.So " ti " will be the selection of determining.System considers that now " ti " and remaining button press (value) _ 8 (for example " t, u, v "), 5 (for example " g, h, i ") and 3 (for example " d, e, f ").These inputs are compared with having the word lexicon that corresponding button presses database, and the word that can demonstrate corresponding to these inputs is that unique word is word " title ".Then, word " title " is selected by system.
For identification better, when pressing corresponding button, the user can say the sub-voice more than one word.In this case, system can consider described input by voice, so that discern the character corresponding to the sub-voice of described described character more than better.
Under every kind of situation almost, by importing word (having one or more part/syllables) by keyboard/, and part/entirely say described word, press in conjunction with button corresponding to the residue character of described word, (preferred by speech recognition system (helping) at least one described part/syllable of described word by determining of pressing of corresponding button, the identification of minority beginning character first/syllable) will produce described word.
In another example, in order to import the word " taken " that comprises two sub-voice/syllables " t a " and " ken ", when input first character " t " when (button 3301), the user says " t a " and then presses residue button (for example " a ") corresponding to the residue character of first syllable.Then, the user proceeds to next syllable very naturally, and says " ken ", presses the button 3305 corresponding to letter " k " simultaneously, and continues to press the residue button corresponding to the described following syllable of letter " en ".Then, he can press for example space bar, so that reporting system data end of input.
After finishing above-mentioned identifying, if selected output comprises the word more than, then can be shown to user's (for example in tabulation that display shows) to described word, then, the user can be by for example pressing " select " button, and one of them is selected to them.
Shortcut: press with the less button that combines to the small part phoneme
The small-sized mobile electronic device that possesses the keypad of the button that has limited quantity worldwide is extensive use of.The user presses the button of described keypad by the finger (for example thumb, forefinger) that uses a hand.Even in above-mentioned data entry system, wherein, press each symbol of action input by the single on corresponding button, the data input speed is slower than the data input speed of using the PC keyboard, in the PC keyboard, the user often uses the button of the finger of two hands by lower keyboard.
In order to strengthen data entry system of the present invention and to allow faster data (for example text) input, grand other data/text input system of level has been proposed in PCT application PCT/US00/29647.In described PCT application, mention, can distribute to the button of keypad to grand (for example letter/character string), and by in conjunction with/do not press action to import in conjunction with the single of sound/speech.Press by the button of at least a portion of the character of word being distributed to single, can press the whole word of input by a fewer keys.By this method is applied to of the present invention press and the data entry device of speaking in, can be provided for the rapid data input of mobile environment/mini-plant.In the method, the number of times that button is pressed is less than the number of characters (except single character and some words of dictionary for example, they may need the character imported by character) of word usually.
As mentioned above, may distribute to predetermined key different on the keypad to phone set corresponding at least a portion (comprising one or more syllable) of the voice of the word of one or more language.Equally, as mentioned above, each described phone set at least one character set in can representation language.As mentioned above, preferred, representing that for example the phone set of the character string of letter (for example character set) is distributed to the identical button that is assigned to another phoneme of the initial character of representing described character string.
According to a preferred embodiment of the invention, preferred, the user can press the button corresponding to the initial part of word, and preferred, says corresponding part simultaneously.For this reason, the user can be divided into the different piece syllable of the voice of for example described word (for example, according to) to word.In this application, each part/syllable of saying word is called as " sub-voice ".Be appreciated that the phone set (with they corresponding character set) corresponding to the described part of dividing of described word must be available in native system.
According to this embodiment, for example, in order to import word " tiptop ", it can be divided into two sub-voice (for example in the present embodiment, according to its syllable) " tip " and " top ", the user may at first push button 3301 (for example described button being distributed in phoneme/letter " t ") also (preferably, say simultaneously) " tip " (for example first sub-voice of word " tiptop "), then, he can push button 3301 also (preferred, say simultaneously) " top " (for example second sub-voice of word " tiptop ").Use the example table among Figure 37, character set " tip " is distributed to letter " t " on phone set " tip " and the button 3301.When the user pushes button 3301 and when saying " tip ", system compares user's voice and all phone set/speech patterns of distributing to button 3301.After selecting to mate (or a plurality of) described phone set/pattern of described user's voice most, system is selected the character set of distributing to described selected phone set.In present example, a unique character set (for example tip) is distributed to phone set " tip ".Then, system proceeds to the next part (for example sub-voice) of word in the same manner, and is like that.In this example, character set " top " is to distribute to unique character set of phone set " top ".Described character set is selected by system.According to one embodiment of present invention, to after selecting corresponding to all character set of all sub-voice/phone set of word, system can then carry out combination to the described character set (for example example of the anabolic process of describing) that kinds of characters collection/string is provided in next paragraph.Then, system compares the word of the dictionary of word database available in each described character set and the storer.For example, after a word of the dictionary of having selected to mate most one of described character set, system can select described word as final selection.In this embodiment, after second part/syllable of input, the user presses for example space bar or another button, and not the reporting system word by fully the input (for example, push button and not sounding can be assigned to for example character such as punctuation mark, PC function).This problem was explained in the PCT application of having been submitted to by the inventor.System makes up character set " tip " and " top ", and produces character set " tiptop ".If desired, system then compares described character set and the word in the dictionary (for example English dictionary) of the word database of system, and if one of described word coupling described character set, the then described word of system's I/O.In this example, word " tiptop " is present in the English dictionary of system.Finally, described word is transfused to/exports.
Figure 38 shows the selected character set combined method of present embodiment.For example, as the embodiment of user's the application of the invention, when attempting with three sequence input words " envelope ", 1 to 2 character set 3801 is selected for each part by system.As shown in figure 39, then, system can make up described character set according to they positions separately in described word, and different character set 3802 is provided.Described character set 3802 will compare with the word of the word lexicon of system, and finally selects and import the character set of the one or more described words of coupling.In this example, character set 3803 (for example " envelope ") is unique character set of the word in the described dictionary of coupling.Described word is finally selected.
As mentioned above, in some cases, speech recognition system be word all/partly (for example syllable) voice selecting is more than a phone set/speech pattern.For example, according to embodiments of the invention, attempt to import word " teabag " if having the user of " bad luck " accent, he at first pushes button 3301 and say " t e " simultaneously.That the uncertain user of possibility of system says is " t e " or " th e ", and they are assigned to described button.In this case, the different character set corresponding to two phone set can be selected by system.Then, the user is by using the second portion of identical process input word.In this example, select a unique character set " bag " by system.The user presses space bar at last.Then, system can make up (with different arrangements) to described character set, producing different character set, and the word of the dictionary of each described character set and word database is compared.In this example, possible character set can be:
-“teebag”
-“teabag”
-“thebag”
Unique character set of the word in English language for example in the coupling word lexicon is word " teabag ".This word can be considered to final selection.
As just describing, may generation systems be word each/some phone set select the situation more than a character set.In this case, can be to making up more than a character set.Therefore, possible, the word more than of dictionary can mate described character set.In this case, described word be shown to user's (for example in tabulation that display shows) and user can by for example " select " button select them one of them.Equally, if system comprise enough internal memories and have enough processing speeds, according to corresponding phrase in the context for example, can use speech recognition system that one of described word is selected.
If the part of word/word comprises a plurality of phonemes, and its voice comprise single syllable,, give described word the phone set/mode assignments of all described phonemes of a part that comprises/consider described word/word according to a kind of method.For example, in order to import word " thirst ", the phone set that all phonemes by described word are constituted is distributed to described word and letter " t " (key) (for example being positioned at/distributing to button 3301).For example, the user pushes button 3301 and say " thirst ".As what explain above, sub-voice () the character set (in this example, having only " thirst ") in this example, sub-voice, and make up their (not making up in this example) of word is selected by system.Then, system can compare the word of the word lexicon of described character set and system, and if one of word described in the described character set coupling dictionary, then system selects described word to select as final.In this case, word " thirst " is finally selected.
In many cases, particularly when word includes only a syllable,, may need to press and surpass once for the syllable button in order to eliminate the ambiguity of word.For this reason, different user friendly methods can be implemented.For example, originally comprise that the word " fire " of a syllable can pronounce with two syllables that comprise phone set " fi " and " re " respectively.In this case, the user can at first press corresponding to the button of letter " f " and say " fi " simultaneously.Then, he can press the button corresponding to letter " r ", and can say " re ".
Equally, for example, the word " times " that pronounces with two syllables " ti " and " mes " or " tim " and " es ".Equally, for example the word of " listen " can pronounce with two syllables " lis " and " ten ", and they may need to press corresponding to the button of letter " l " and " t " respectively.Equally, around this principle, can be divided into three parts " thir ", " s " and " t " to word " thirst ".For example, consider by may be assigned to the button (for example button 3301) that comprises letter " t " to phone set " thir ", the user can push button 3301, and say " thir ", he can press the button 3306 corresponding to letter " s " then, and sends the sound of phoneme " s " or say described letter.Then, he can press the button 3301 corresponding to letter " t ", and sends the sound of phoneme " t " or say described letter.At the end of word, the user can press for example word end key of space bar 3307.
Equally, begin to locate to have for example required phone set number of word of same voice (for example " bring " and " brings ") in order to eliminate indistinct better and to reduce at it, except first button of pressing syllable and say the described syllable, in many cases, can press and say for example one or more characters of the last character of word/syllable (for example " s " in this example).For example, the user can press corresponding to the button of character " b " and say " bring " (for example, phone set " bring " being distributed to button 3302).Then, he can press the button corresponding to letter " s ", and sends the sound of " s " or say the sound of phoneme " s ".After the word end signal of pressing " space " key for example is provided, system will consider two data list entries, and corresponding word " brings " (for example, its phone set is not assigned to button 3302) is provided.Be appreciated that by making in this way any position in word import one or more monocases (for example begin, middle, ending) all be possible.In order not make system fascination, when a part of input system input of user by word/word of the present invention comprised the part of (word) letter, preferred, the user can say the sound of described letter.For example, the user can send the sound of phoneme " m ", and does not say " em ".Equally, under analogue, can be associated with character string " tea " saying " t " by system, when sending the sound of phoneme " t ", " tea " and letter " t " can be associated with unique letter " t ".
As mentioned above, indistinct in order to eliminate better, can be divided into the sub-voice of the syllable/word of a part/word of word/word more than a part with a large amount of phone set, the described part of some of them can include only a phoneme/character, and data entry system according to the present invention is imported.Equally, as mentioned above, according to this method, wherein each comprises that a plurality of phone set of a small amount of phoneme can replace the single phone set that comprises a large amount of phonemes, is used to represent the part (for example syllable) of word.Equally, as mentioned above, the voice of the long part of word (long that for example comprises a large amount of phonemes) are divided into shorter sub-voice/phone set part minimizing are used for discerning the sum of the required phone set of all available words of dictionary database.Similarly, as described above, this will allow phone set is still less distributed to each button of keyboard/.
According to one embodiment of present invention, based on above-mentioned principle, the short phone set that comprises a small amount of phoneme is distributed to each button of keyboard/.For this reason, for example, if phone set begins with consonant, it can comprise following structure/phoneme:
-described consonant only arranged
-begin with described consonant, and at least one vowel is subsequently
-begin with described consonant, at least one vowel after described consonant, and
A consonant is after described vowel
If phone set begins with vowel, then it can have following structure:
-begin with at least one vowel
-begin with described vowel, and a consonant is subsequently
Figure 40 shows according to embodiments of the invention, some examples of the phone set 4001 of consonant " t " 4002 and vowel " u " 4003.Row 4004,4005,4006 show according to the sound set (for example consonant/vowel) that constitutes described phone set, the different piece of described phone set.Row 4007 show corresponding exemplary word, and wherein, corresponding phone set constitutes the part of the voice of described word.For example, phone set " t ar " 4008 constitutes the part 4009 of word " stair ".Row 4010 show the exemplary estimated (according to this embodiment of the invention, button is pressed first character corresponding to each part of word) of the number that the button that is used to import corresponding word presses.For example, in order to import word " until " 4011, the user will at first press the button 3301 (referring to Figure 33) corresponding to letter " u ", and preferred, say " un " simultaneously.Then, he presses the button 3301 corresponding to letter " t " once more, and preferred, also says " til " simultaneously.In order to finish this word, the user is then by for example pressing the word end signal reporting system of space bar.Press (not comprising the word end signal) and user's voice by twice button, be transfused to up to word.According to current embodiment, there is not the consonant phoneme of vowel can be considered to the unitary part of word pronunciation in its front and back based on aforementioned principles.For example, defer to this principle at " s " that word " study " 4012 begins to locate and " s " that in the middle of word " understand " 4013, locates.This will reduce significantly be used for importing the required phone set of the available most of words of dictionary number (for example, when using the telephong type keypad, each of word begins phoneme/character part may have about 100 phone set, and this may be enough to discern the most of words in the English language for example).Figure 40 shows other beginning phoneme/character of for example " v " 4014 of the button 3301 of distributing to the telephong type keypad and " th " 4015.To each described beginning phoneme/character, can consider phone set according to above-mentioned principle.
Be appreciated that if the word than eldest son's phonological component of required/expectation has a plurality of syllables, can utilize the short phone set of native system to consider equally.Equally, for example, also can consider more than the phone set of the syllable of one word, and it is distributed to described respective keys expression.Equally, for more easily identification, described in former embodiment, in order to allow better being that the voice that the native's in non-Oral English Practice area user sends are discerned in many cases, can corresponding to the phone set with indistinct similar pronunciation (for example " t o " and
) character set distribute to all described phone set.
Identical predetermined (preferred, weak point) phone set/speech pattern can allow identification and input word in multilingual.For example, phone set " sha " can be used to discern for example following word:
" shadow ", English
" Chaleur ", French
" shalom ", Hebrew
" shabab ", Arabic
" Geisha ", Japanese, etc.
Can distribute to each described phone set to corresponding character set in the corresponding language.As mentioned above, by doing like this, can provide powerful multi-language data input system based on phone set identification.For this reason, the one or more databases in the different language can be available in system.Can consider in different language, to be used to import the distinct methods of different texts.
According to a kind of method, by having phone set database common in many language and corresponding character set data storehouse, for required language input text, the user can be by selecting language mode by the predetermined way reporting system.For example, described user can press mode key to enter into required language mode.In this case, according to corresponding embodiment of the present invention, after importing word by a part of importing described word, system will compare to the selected corresponding collection/string of combining characters collection with corresponding to the word of the word lexicon of described selected required language.After one or more words of described character set and described dictionary were complementary, system selected described word as the final selection of carrying out I/O.If this selection comprises a word, then described word can become final selection.If this selection comprises the word more than, then described word is shown to user's (for example in tabulation that display shows), and the user can be by for example using " select " button, one of them is selected to them.
According to another kind of method, system can with different language in all databases will be used simultaneously, allow to import any word entries (for example in same document) with different language.For example, after the part input word by the described word of input according to one embodiment of present invention, system can to selected corresponding character set and system can with the word of all word lexicon compare.Described character set and system can with different dictionaries in after available word compares, system selects the word of described coupling as the final selection of carrying out I/O.If this selection comprises a word, described word can become final selection.If this selection comprises the word more than, then described word is shown to user's (for example in tabulation that display shows), and the user one of them is selected to them by use " select " button for example.
In some language of for example Hebrew or Arabic, wherein most of vowels are by single character representation, this system even can use higher precision work.
Do not compare with word lexicon
Native system also can carry out work under not to the selected character set of combination and the step that compares of word lexicon.This is to being useful with different language input texts, and does not worry whether they exist in the word lexicon of system.For example, if system does not comprise the Hebrew word lexicon, the user can be by using Roman character with the Hebrew input text.In order to import word " Shalom ", the user will use the available character set in system of the phone set " sha " that exists and " lom " and their correspondences.Use for example device reporting system of mode key: do not carry out described comparison with dictionary database, the combining characters collection will be transfused to/export, or be displayed to the user and be used for confirming.If produced the combining characters collection more than, they will be displayed to user's (for example in tabulation that display shows), and the user can be by for example pressing " select " button, and one of them is selected to them.
In the part input embodiment of word/word of the present invention,, then the word erase feature is distributed to button if the word of I/O is not user's needs that.Be similar to character erase feature (for example deletion, backspace) key, press the word that the word erase key will be wiped cursor front on the display for example.
According to a further embodiment of the invention, preferred, most of phone set of system can only have a consonant.Figure 41 shows some this phone set as example.According to present embodiment, for example, in order to import word " teabag " 4101, the user at first pushes button and 3301 says " t e " simultaneously.Then, he pushes button and 3302 says " ba " simultaneously.At last, he pushes button and 3303 says " g " (or saying the sound that sends phoneme " g ") simultaneously.As in another embodiment, at the word end, he can press for example button of space bar.
In order to respond and increase the accuracy of system better, can combine automatic correction software with embodiments of the invention.Automatically correction software is by known to those skilled in the art.For example, (by considering the keypad of Figure 33), when the user attempted to import word " network ", he at first pressed the button 3308 of the keypad that letter " n " is assigned to and says " net " simultaneously.Letter " m " also is assigned to same button 3308.In some cases, system may be identified as user's voice " met " mistakenly, and is for example character set of " met " of described voice selecting.By pressing the button 3304 of the initial " w " corresponding to described syllable, the user proceeds to the next syllable of input, and says " work ".System discerns the phone set of being sent by the user " work ", and selects corresponding character set " work ".Now, system makes up two selected character set, and obtains word " metwork ".By this word and the word that exists in the dictionary of the word database of system are compared, system may not be complementary the described synthetic word and any described word of described database.Then, this system will attempt described synthetic word and the most alike word are mated.In this case, according to a hypothesis, system can replace letter " m " with letter " n ", is provided at word available in the described dictionary " network ".According to another hypothesis, by consider to discern " m " and " n " by mistake by speech recognition system, and the both is positioned on the same key, and system can use phone set " net " replacement " met ", and selects to distribute to the character set " net " of phone set " net ".Then, by with character set " net " substitute characte collection " met ", will synthesize word " network ".Described word is available in the word lexicon of system.It will be finally selected.
In another example, input " that " may be " vat " by system identification.Identical process will be eliminated the ambiguity of described word, and correct word " that " will be provided.
In another example, if system can not be complementary the synthetic character set and the word of dictionary, then the automatic correction software of system can be determined the position that the character of described composite characters collection (relevant mutually) (for example syllable) and/or described composite characters in corresponding part are concentrated, and attempts the word of described character set and dictionary is complementary.For example, if character not in described character string/group, by with the described comparison of the word of dictionary, system can identify mistake, and the correct word of output/input.For example, if the user of (for example with four parts) input words " un-der-s-tand " forgets " s " part of the described word of input, then one of composite characters collection can be character string " undertand ".Consider by the position that character and they to described character string are relative to each other in described character string, and the word of described character string and dictionary compared, it is word " understand " that system can discern required word, and with the described word of final I/O, or it is shown to the user, for user's decision.In addition, the automatic correction software of system can comprise the part or all of function by other correction softwares well known by persons skilled in the art.
Have for example " to " of same pronunciation (for example, and distribute to same button), particular processing can be deferred in the word of " too " or " two ".For example, the word of the most generally using in these words is word " to ".Can import this word according to embodiments of the invention.Can give tacit consent to the output of this operation is word " to ".Say " t o o " simultaneously by pressing, input word " too " (with two parts " to " and " o ") corresponding to the button of letter " t ".Before pressing the word end key, the user can also by press corresponding to the letter " o " button and say " o " and import another character " o ".He can press the end point button now.Word " too " will be identified and import.In order to import word " two ", system can import it character by character, or for example specific human voices of " tro " is distributed to described word, and uses this embodiment to import.Equally, for example, in order to import " two ", the user can push button 3301 and send the sound of long " t o o ".For input digit " 2 ", the user presses corresponding button 3302, and sends the sound of described numeral.Be appreciated that example is shown to be illustrated as an example here.Those skilled in the art can consider to import the additive method of the word with roughly similar pronunciation.
Just now mentioned an absorbing problem.For example, by saying " fiv " and pressing button 3309, will import word " five " corresponding to the initial of word " five ".What is interesting is, by say " fiv " and press corresponding to the numeral " 5 " button 3305, with input digit " five ".By saying the word corresponding to two distinct symbols, and use button to press, user's intention is illustrated.This is one of shortcoming of only importing by data, and wherein, user's intention can not considered by the sound/speech recognition system.Equally, for example, can be distributing to identical numeral more than one voice.For example, can distribute to numeral " 4 " to two voice " four " and " forty ".The user can by say " four ", " five " presses corresponding button simultaneously, or say " forty five " and press same key simultaneously and produce numeral " 45 ".Equally, when the user pushes button 3306 and say " seven ", with input digit " 7 ".This is because in order to import word " seven ", and the user can push button 3306, and says " se ".Then, he can push button 3301 and say " ven ".
In other language of for example French, wherein, the voice of numeral " 7 " comprise a syllable, in order to eliminate indistinct purpose, can distribute to character set " sept " to the voice of the self-defined generation with two syllables.For example, word " septo " can produce and adds word lexicon to by the user.This word can point to the word " sept " in the dictionary.When the user imports word " septo " (according to current embodiment of the present invention), system will find out described word in the word lexicon of system.System is pointed to I/O by word " septo " word, and the described word of not I/O.Described word is word " sept ".Can be in independent database, the symbol of the generation of the word that points to dictionary database is arranged.
According to another kind of method, digital distribution is given and the first mutual pattern of button, and represent that the character set of described numeral can be assigned to another pattern mutual with described button.For example, can press action (for example when saying it) to the single that numeral " 7 " is distributed on the button 3306, and can press action (for example when saying it) to twice that character string " sept " distributes on the same key 3306.
Must be noted that at least a portion voice (for example sub-voice of word) that sub-voice level data input system of the present invention is based on word are discerned.Consider that many words have common sub-voice in one or more language, by modification/interpolation phone set a little, and a corresponding character distributed to described phone set, the multi-language data input system may become available.For example, for example English, German, Arabic, Hebrew and even the multilingual of Chinese can comprise the word that possesses the part/syllable that has similar pronunciation.
Be appreciated that the user can add the word of new standard or white definition generation, and corresponding voice added to the dictionary database of system.Therefore, system can produce corresponding button value of pressing and speech pattern and add corresponding database to.
As mentioned above, in order to import word, the user can press corresponding to the button of the initial character/letter of the first of word and say described part (phoneme).If to say described word more than a part, then the user can repeat this process to each remainder of described word.
According to one embodiment of present invention, when the user presses corresponding to the button of the initial of word (for example syllable) part and says described part, the sound/speech recognition system is heard described user's voice and is attempted the part of (preferred, begin part at least) described voice is at least mated with the phone set of distributing to described button.Select the phone set of mating most and select corresponding character set by system.By repeat to select one or more character set to each part (for example syllable) of described word respectively after identical process imports whole word for each part of described word (for example syllable).Now, system can have one or more character set to each part (for example syllable) of word, and wherein each character set can comprise to the character of the described syllable of small part (preferred, beginning part).Then, system will attempt (beginning) character of the corresponding syllables of the word of the dictionary of the word database of each described character set and system is complementary.The word that mates most is with selected.In many cases, only select a word of dictionary.Described word will be transfused to/export.If selected more than an available word, described word will be displayed to user's (in tabulation that display shows), and the user can by for example press " select " button select them one of them.
For example, form by using Figure 37 and the keypad of Figure 33, for import word " trying " (for example phone set "
"), the user can at first push button 3301 and say
System is complementary user's voice and the corresponding phone set of distributing to button 3301, and selects corresponding character set (for example, in this example, " try ", " tri ").Then, the user presses corresponding to the button 3303 of character " i " and says " ing ".In this case, system the beginning of user's voice part and the phone set of distributing to button 3303 " in " (for example, phone set " ing " does not exist in exemplary database, so it is not assigned to described button) be complementary, and select corresponding character set " in ".Now, the user has finished to import word, and his end of input point (for example word end) symbol, for example presses space bar, or press any button and silently (for example, push button and and silently can be assigned to for example character such as punctuation mark, PC function.This problem was explained in the PCT application of being submitted to by the inventor).System can produce different character set now, and each comprises the possible character to the small part beginning character of each part/syllable of required word.In this example, can produce two character set.Described character set is:
“tri-in”
With
“try-in”
Have only second character set (for example " try in ") corresponding to the word that exists in the English dictionary, wherein, described word is included in the letter " try " that its first syllable begins to locate, and comprises the letter " in " that another (for example second) syllable of described word begins to locate.Described word is word " trying ".
In native system, the quantity that is used to discern the phone set/speech pattern of many whole-word needs will be reduced significantly.On the other hand, can increase the quantity of the character set of the described phone set of expression, but required memory span will not influenced significantly.
In many cases, have only the character of a described combination to be complementary with the word in the dictionary.Described word will be transfused to/export.If corresponding to word available in the dictionary, then can be shown to user's (for example in tabulation that display shows) to described word more than the combination of a character set, and the user one of them is selected to them by for example pressing " select " button.
As mentioned above, system can select word according to the one or more described selected character/phone set corresponding to the voice/sub-voice of described word.
In many cases, system may not consider one or more described selected character/phone set, in view of them by system by wrong choice.Equally, as required, system may only consider part (preferred, the beginning) phoneme/character by the phone set/character set of system's selection.For example, if the user attempts with four parts " de-mons-tra-ting " input word " demonstrating ", and system mistake selected character set " des-month-tra-ting ", according to a kind of recognition methods (for example, word to described character set and dictionary compares), system may not have the word of discovery corresponding to the combination of described character set.Then, system may notice, the letter " de " of the character set by considering first selection and the letter " mon " (minority begins letter) of second character set, and consider that third and fourth character set, required word may be word " demonstrating ".Equally, if desired, system can add character in the character string (selection character set) of combination to, and perhaps delete character from described character is used for the word of the coupling of itself and dictionary is complementary.For example, if the user attempts to import word " sit-ting " with two parts, and system mistake selected character set " si-ting ", according to a kind of recognition methods (for example, word to described character/phone set and dictionary compares), system can determine must add letter " t " afterwards at letter " i " in described character string, is used for itself and word " sitting " are complementary.In another example, if the user attempts to import word " mee-ting " with two parts, and system mistake selected character set " meet-ting ", according to a kind of recognition methods (for example the word of described character/phone set and dictionary being compared), system can determine and must delete letter " t " afterwards by letter " e " in described character string, be used for itself and word " meeting " are complementary.
The end (for example having described word) of the part of word and the ensuing part of described word more than a part/syllable begin have identical phoneme and can make system have recognition accuracy better.
According to one embodiment of present invention, for example, for (the distributing to button) phone set that finishes with the phoneme of for example vowel, can be to comprising described phone set and consider with other phone set of other phonemes endings of for example consonant, and it is distributed to described button.This can improve the accuracy of identification.For example, by reference Figure 33, when input comprised the word " coming " of two parts " co-ming ", the user can push button 3302 and say " co ", and he can push button 3308 and say " ming " at once then.Because the first of sub-voice is too short, if phone set " com " is not assigned to the same key 3302 that is assigned to phone set " co ", when pressing described button and saying " co ", possible generation systems possible errors identification is also for example selected by the described part voice that the user says
The situation of the phone set of the mistake of (for example, character set " call " is assigned to).On the other hand, if phone set " com " is also distributed to described button, then the beginning phoneme " m " of part " ming " will be similar to the end phoneme " m " of phone set " com ".In this case, two phone set " com-ming " and their corresponding character set (for example, as an example, " com/come " and " ming ") can be selected by system.After combining characters collection and dictionary word were compared, system can determine one " m " of deletion in one of described combining characters collection, and the word " coming " of described combining characters collection and dictionary database is complementary.
In order to discern the voice of saying better by the user, in many cases, described user may be the locals in non-Oral English Practice area, can distribute to all described phone set correspondingly distributing to the character set with indistinct phone set (for example " vo " and " tho ") of roughly similarly pronouncing.For example, can identical (for example, common) character set " tho ", " vo " and " vau " etc. distribute to each phone set " vo " and " tho ", wherein, selecting described character set by system and producing under the situation of corresponding kinds of characters collection, the word of the dictionary database of described collection and system is being compared the word that can cause selecting required described dictionary.
For example importing by slight keyboard, the data of text have seriously reduced the data input speed.Based on single button pressed in each part/syllable of word, the data entry system of the present invention of saying described part/syllable has simultaneously improved the data input speed significantly.This system also has many other advantages.An advantage of this system is that it can press perhaps single button and (pin-point accuracy ground) identified word by each part (for example syllable) to described word.Another significant advantage of the present invention is that the user does not need to worry that spelling/mistake is imported word by mistake, and particularly in the data entry system of word forecast (for example by importing first letter of each part) may cause the whole word of mistake identification/nonrecognition.Equally, another significant advantage of native system is when the user presses button corresponding to the initial of word part, he during described button is pressed, speak (described part).At the end of word, the user can be by pressing described button the default symbol of the silent input punctuation mark of for example (distributing to button).As mentioned above, this button is pressed also and can be used as the word end signal.For example, the user can be by pushing button 3303 and say simultaneously
Input word " hi ".Then, he can push button 3306 and sounding not.This will notify, and the word input finishes, and must add the end of described word to symbol ", " to.Final I/O will be character set " hi, ".
The data entry system that the present invention describes is the derivation by the data entry system of describing in the PCT of inventor's submission and the US patented claim.Character data input system by the complete PC keypad function described in the application before being provided at and in described PCT application and the application, describe the combination of character of part level data input system of word/word will in moving (or even fixing) environment, provide very quick, convenient and natural data input, allow the rapid data of the keyboard (for example keypad) by miniaturized electronics to import with the button that reduces quantity.
As mentioned above, data entry system of the present invention can use for example any keyboard of PC keyboard.Similarly, as described above, according to data entry system of the present invention, can be by pressing described button the symbol on the silent input keyboard button.Data entry system of the present invention can carry out optimum operation with the keyboard of for example Standard PC keyboard, wherein, gives predetermined push on one or more buttons single allocation of symbols.As use known to the example people of computer keyboard as shown in Figure 42, for example, by the button 4201 of pressing PC keyboard 4200, can input alphabet " b ".Equally, for example, by pressing shift 4202 and button 4203 simultaneously, can incoming symbol " # ".
By data entry system of the present invention and this keyboard are combined, on the one hand, the user can not say described data corresponding to the button of desired data and uses described keyboard (this allows silent import single letter, punctuation character, numeral, order etc.) as usual by pressing, and on the other hand, described user can also (preferably, simultaneously) press corresponding button and import desired data (for example part of word/word) by saying described data.For example, by using for example keyboard of PC keyboard, for input alphabet " b ", the user can push button 4201 and sounding not.In order to import word/syllable " band ", the user can push button 4201 also (preferred, say simultaneously) " band ".Do not need to be used to change other operations of pattern, on the one hand, this allows the user to use keyboard as usual, and on the other hand, can allow described user by say described grand also (preferred, simultaneously) press corresponding one or more button and import a part grand of word/word for example.Equally, for example, in order to import the word " bible " that constitutes by two parts (for example two syllables) " bi " and " ble ", user's principle of data entry system of the present invention (as mentioned above, according to) can push button 4201 and say "
".Then, his can push button 420l and say " bel ".
As mentioned above, the combination of the character of the part level data input system of the character data input system by the complete PC keypad function described in the application before being provided at and word/word of describing in described PCT application and the application will provide very quick, conveniently and natural data entry system in moving (even fixing) environment.
The voice of word may comprise also the one or more sub-voice corresponding to single character.For example, by reference Figure 33, when the user pressed the button 3302 of keypad 3300 and says " b ", the described data of input can be corresponding to letter " b ", word " be " and word " bee ".According to an embodiment, system can distribute to the character level data to highest priority, and its (letter " b ") for example in the present embodiment, is used for final input/be shown to user as first-selection.If not being the user, this does not want to import, he can follow and continue to import remaining word character by character, perhaps he for example can press end key to finish the input of described word, and then for example operate options button, so that asking of other selections (" be " and " bee " for example in this example) navigate and select that he needs that.
According to this method, also for example, when input word/character string, described word/character string starts from corresponding to single character and finally corresponding to the sub-voice of the voice of the part of word/word of distributing to described button, even before importing the word end signal by the user, described character also can be given highest priority and finally be presented on the display of corresponding apparatus.If the input next voice a part/sub-voice still corresponding to/also corresponding to single letter, then repeat this process.If for example the word end signal of space bar is produced, described character string can be given highest priority and remain on the display.Proceed to the affirmation that the next task of for example importing next word will be considered to be accepted by the user described character string.If the identical data of input is also corresponding to the one or more words that mated by system, described word to the user also be available/be shown to the user.Do not wish to import if the single character string of described printing is not the user, the user can for example use options button to navigate between described word and select him required one.
Continue to describe embodiments of the invention, if one of data (voice/part voice and/or button are pressed) of importing in the part of input word/word do not correspond to single character and have imported the word end signal, then can delete the character of described demonstration, and replace (corresponding to the described data) word with highest priority is shown to the user.If the identical data of input if be ready, also can be shown to the user to described word also corresponding to a plurality of words.In this case, the user can for example use options button to navigate between described word and select his required word.
By using standard telephone keypad and data entry system of the present invention, can notice in English, there is not such word, that is, it has the syllable more than, and wherein the voice of all described syllables are all corresponding to the single letter on the corresponding button.
Have many single syllable words, it is corresponding to the character (for example " b, be, bee " or " t, tea, tee ") on the corresponding button.As mentioned above, in these cases, described single character can be given highest priority.
According to above-mentioned principle, for example:
-in order to import " b ", the user presses corresponding to the button of described letter and says " b "
-in order to import " bmx ", the user presses the sound that corresponding button sends corresponding letters simultaneously
-in order to import " bmx95 ", the user presses corresponding button and sends the sound of respective symbols
-in order to import word " before ", the user can press the sound that corresponding button sends corresponding letters (for example data input character by character) simultaneously, perhaps for example, he can at first press corresponding to the button of letter " b " also (preferred, say simultaneously) " b e ", and then press corresponding to the letter " f " button and say " for ".When finishing, he imports the word end signal, for example presses space bar (for example a part of input system of word/word).
The advantage of this method is that the user can change and not be used between the different mode in conjunction with a part of data entry system of the input of data character by character of the present invention and word/word of the present invention.
Data entry system of the present invention is complete data entry system, the user is imported at any time comprise for example arbitrary string of the symbol of letter, numeral, punctuation mark, (PC) order, or input is present in the word in the dictionary database.
According to one embodiment of present invention, before the process that compares in combination with the word of dictionary database, the character set of being selected by system can be shown to the user.For example, after the part of each input word, can be shown to the user to character set immediately corresponding to described input data.The advantage of this method is, after a part that follows the input word closely, the user can verify by system whether wrong identification the part of described word.In this case, the user can delete described part and repeat (if desired, importing described part character by character) described input, up to the correct character of input corresponding to described part.Can provide to allow the button of deletion, rather than delete character one by one corresponding to the importation of word corresponding to the whole character of described part.According to one embodiment of present invention, can use same key to delete the part of whole word and/or word.For example, single is pressed the entire portion that described button can cause deleting the word of input (for example, the cursor that is located at after the described part by system/user/points out that to system described part is with deleted).Clearly, other identical push other parts that can delete the word before described cursor at every turn.Equally, for example, press described button for twice and can cause deleting all parts into described word input (for example, be positioned at follow the cursor reporting system of wanting after the deletion closely must delete all parts that are positioned at described cursor word before).
The user may be taken place wish to import for example character string of " systemXB5 " that comprises whole word and single character.
According to an embodiment, import corresponding to part after the described character string, or when the described whole end of string of input, system can discern does not have word corresponding to selected character set in the dictionary at every turn, this character set is corresponding to each part of word.On the other hand, system can discern the combination of character set of some Continuous Selection corresponding to the word in the dictionary database, and other are corresponding to single character.In this case, system will form output, and this output comprises the word of described character and single character string.In the above example, with five parts " sys-tem-x-b-5 " input word " systemXB5 ".
For example, by using telephone keypad as shown in figure 33, the selected character set of pressing corresponding to button and the voice of each part can be as follows:
PartSys tem x b
5
Character setSis/sys tem/theme x b/be/bee
5
After comparing in combination and to the word of described character set and dictionary, system can not have the combination of word and described selected character set to be complementary in the identification database.System can discern then, corresponding to word, has on the one hand the some parts corresponding to single character in described database, and on the other hand, has the combination of single character set or continuous other character set.Then, the described combination of system's I/O.In this example, system's combination and the word " system " that can discern first and second character set " sys " and " tem " is complementary.The the 3rd and the 5th character set corresponds respectively to letter " x " and numeral " 5 ".The 4th part can be corresponding to letter " b " or word " be " and " bee ".
System can illustrate following selection to the user according to their right of priority:
“systemxb5”
“systemxbe5”
“systemxbee5”
Be appreciated that for the identifying that makes the character string that comprises single character and whole word more or less freelyly, the user can be emitted in the signal that word/character begins/finishes described in the described string by the prearranged signals of for example pressing predetermined key.
According to one embodiment of present invention, preferred, when possible, can divide in the mode that vowel begins with the voice of described part in order to import the word that is divided into more than a part.For example, can be divided into part " merch-and-ize " to word " merchandize ".Equally, for example, can be divided into " man-ip-ul-ate " to word " manipulate ".
Equally, for better result, when the word to described character set and dictionary database compares, can consider corresponding phone set corresponding to the selected character set of phone set, described phone set is corresponding to the part voice of word.For example, in English, can be the character set of " air ", " ar " and " are " for example for the respective symbols collection of phone set " ar ".Respective symbols collection for phone set " r " can be " are " and " ar ".In this example, two phone set have similar character set " are " and " ar ".Under the situation of wrong identification input, system can attempt eliminating ambiguity or trimming process (for example changing order).Know which phone set is character set relate to and can help system carry out described process better.For example, if the user wishes to import word " ar ", and identification described voice in system mistake ground are " ab " (for example, nonsensical in this example).For the relevant character collection of the phone set of described wrong identification can be the character set of " abe ", " ab " for example.By considering described phone set, system is words such as directed for example " aim ", " ail ", " air ", rather than the word of " an ", " am " (for example relating to phoneme " a ") for example.
As mentioned above, expression also is considered more than the phone set of the syllable of a word and distributes to button, and by embodiments of the invention inputs (for example, corresponding to the phone set of the part of word can by saying it and pressing corresponding to the button of the initial character of described part and import) with two syllables.Equally, as mentioned above, can be by saying it and pressing simultaneously corresponding to the button of the first phoneme/character of described word and import whole word.As mentioned above, even can distribute to button and importing as described to word strings.May the generation systems nonrecognition has situation more than the phone set (for example sub-voice) of the word of sub-voice (for example syllable).In this case, can distribute to button to two or more continuous sub-voice (for example syllable) of described word.With reference to Figure 33, for example, can distribute to button 3309 to word " da-ta " (for example, wherein for example system mistake identification phone set " ta ").In order to import described word, the user can push button 3309 and say " data ".
Therefore the data entry system permission input word of pressing and speak of the present invention, can manage the word terminal procedure by system or user respectively automatically or manually.
-as mentioned above, the multiple word that is transfused to is arranged, for example:
-by pressing the single sub-voice/voice that combine, import word (word that for example has a syllable) with a part with corresponding button
-part that word is divided into more than one (for example has the word more than a syllable, perhaps have a syllable but comprise a plurality of continuous consonants or the word of vowel), and import by combining with corresponding button input to each part corresponding to the sub-voice/voice of each part.
According to one embodiment of present invention, the whole word of existing word in importing corresponding to the word database of language, and user input is when for example pressing the word end signal of " word end " button, then described word is thought of as the result of the described data of input that are used to carry out I/O.According to reservation system design/pattern, system for example can consider to add or do not add the character at the space character at described end as a result.If system or user do not import the symbol of space character for example or input function after described word, then next word/the character of input will be connected with the end of described word.
Example:
And then be " word end " button (not having the space) after " FOR ", produce " FOR "
According to a further embodiment of the invention, the whole word of existing word in importing corresponding to the word database of language, and the user then imports described word and described other symbols at the input of the end of described word for example space character, punctuation mark or at least during other symbols of " input " function at least at least.
Example:
" FOR " back is " ", produces " FOR "
" FOR " back is ", ", produces " FOR, "
" FOR " back is ". ", produces " FOR. "
According to one embodiment of present invention, when user input corresponding to the dictionary database of the word of language in the word of existing word, and described user is when then input is also corresponding to the next word (not importing for example word end signal of space character between described two continuous words) of existing word in the dictionary, but, the combination of described two words is not corresponding to the word in the dictionary of word database, and then system can add space character automatically between described two words.
Example: " FOR " back is " SOME ", produces " FOR SOME "
According to one embodiment of present invention, when user input corresponding to the dictionary database of the word of language in the word of existing word, and described user is when then input is also corresponding to the next word (not importing for example word end signal of space character between described two continuous words) of existing word in the dictionary, and, the combination of described two words is during also corresponding to the word in the dictionary of word database, and then system can show two selections to the user.First selection can be the combination (not having space character between them) of described two words, and second selection can be described two words that comprise (or a plurality of) space character between them.According to the design of reservation system for example, meaning that described word is combined and the factor of the meaning of separating, phrase notion etc., system can provide higher-priority to one of described selection, and it is presented on the display of relevant device, is used for the user and confirms.Then, the user will determine which is selected.For example, the input that proceeds to next word/character can be notified the user, and first selection is identified.
Example 1:
" FOR " back is that " GIVE " can produce first selection " FORGIVE "
" FOR " back is that " GIVE " can produce second selection " FOR GIVE "
Example 2:
" WORK " back is that " MAN " can produce " WORKMAN "
" WORK " back is that " MAN " also can produce " WORK MAN "
Said process can be applied to also the word corresponding to for example following word of same principle.
Example:
" WORKMAN " back is that " SHIP " can produce " WORKMANSHIP "
" WORKMAN " back is that " SHIP " also can produce " WORKMAN SHIP "
According to one embodiment of present invention, first word of existing word in importing corresponding to the word database of language, and the user is input to the part of next word/word at the end (not having space character between them) of described first word, and described next word/part does not correspond to the existing word in the dictionary, but with the described next word/part of described first combinations of words during corresponding to the word in the dictionary, then system will couple together described first word and described second word/part automatically, is used to provide word.
Example:
" FOR " back is " CING " generation " FORCING "
" FORGIVE " back is " NESS " generation " FORGIVENESS "
According to one embodiment of present invention, when the part of the word/word of first input is not present in the word database of language, and when the user imports next word/word a part of, system will make up with next part described first, and the word in described combination and the dictionary is compared.If described combination is corresponding to the word in the described dictionary, then system selects described word and finally it is shown to the user, is used for confirming.
Example:
" SYS " back is " TEM ", produces " SYSTEM "
Be appreciated that for better result, also, automatic word terminal procedure combined with user intervention in order to reduce ambiguity.For example, press predetermined key, can must make up described part and its at least one part before by reporting system at latter end.If so definition, space character also can be placed at the end of described combined word by system.
Example 1: do not have user intervention, following situation may take place:
" FOR " back is that " GIVE " can produce first selection " FORGIVE "
" FOR " back is that " GIVE " also can produce second selection " FOR GIVE "
Example 2: adopt user intervention, following situation may take place:
" FOR " back is " GIVE ", and the back is that " " can produce a selection " FORGIVE " again
System is entered, and manual/semi-automatic/automatic word end mode/process can be optional.The user can be by the device reporting system of mode button for example, is used to enter described process or withdraws from from described process.This is because in many cases, and user's possibility would rather manual process word ended questions.
As mentioning in the above embodiments, the user may wish to import arbitrarily one or more words in character string.This problem was described in one of embodiment of front of the present invention.
Example: " 91SYSTEMep7 "
According to one embodiment of present invention, system can show to the user, its input (for example voice and respective keys) afterwards and the part of the word/word of the current input before " word end " signal be transfused to.System can mate the word of described part with dictionary, described part and the part of former word/word, current phrase context etc. is carried out related, with decision which output is shown to the user.System also can itself be shown to the user to described part simply.This process also can make the user can be between word compartment of terrain input word not.For example, selected after the selected result of its demonstration the user, the user can proceed to the part of word/word below the input, and not described first word and described below the part of word/word between add space character.System will connect described two words.
Example:
It after " PRESS " " SPEAK " generation " PRESSSPEAK "
The standard word in dictionary, the word database of system also comprises abb., comprises the word of special character the word that (for example " it ' s "), user produce etc.
With reference to Figure 33, for example, when the user pushes button 3303 and say " its ", word " its " and " it ' s " can select in system, and these two words are assigned to described action and described (part) voice pressed that utilize described button.System can oneself select one of described word (for example, according to the word of phrase notion, front etc.) as final selection, perhaps described selected word to be shown to the user, is used for finally selecting by him.In this case, for example, system can show the have highest priority word of (for example " its ") on the display of relevant device.Wish to import if this is the user, then the user can use the predetermined affirmation device of for example pressing predetermined key, perhaps proceeds to the following data (for example text) of input.Can take the affirmation of the word of accepting current proposition as proceeding to the following data (for example text) of input by system.Do not wish to import if the data of described demonstration/proposition are not the users, then the user can select other selected words (for example " it ' s ") by the selecting arrangement that is provided with in the system.According to another embodiment, when two words have similar pronunciation, can be (for example one of described word of expression, word in above-mentioned example " its ") phone set is distributed to first mutual (for example single is pressed) with button, can distribute to second kind mutual (for example pressing for twice) with described button to the similar phone set of another word of expression (for example word " it ' s ").
As mentioned above, can symbol (for example voice/phone set/character set etc.) distribute to combine/be not combined in button for example in a minute on the pattern/action of for example pressing for twice.According to one embodiment of present invention, the part of indistinct word/word is distributed to described pattern/operation.For example, when the user sent the sound of word " tom " and " tone " (for example distributing to same key), they may cause ambiguity.A solution eliminating their ambiguity is that in them each distributed to the different mode/action of described button.For example, the user can press (for example by next time) button 3301 and say " tom " (for example, phone set " tom " being distributed to the described pattern mutual with described button) by single, is used to import the character set " tom " of example.Equally, described user can push button 3301 and say " ton " (for example phone set " ton " being distributed to the described pattern mutual with described button) for twice, is used to import the character set " tone " of example.
Equally, for example, first phone set that finishes with vowel (for example, corresponding to word to the small part voice) may cause and the ambiguity of second phone set that described second phone set begins the place at it and comprises described first phone set, also comprises other phonemes.Described first phone set and described second phone set are distributed to the two kind different patterns mutual with button.This can improve the accuracy of sound/speech identification significantly in noisy environment.For example, when saying, may cause and ambiguity corresponding to character set " mall " corresponding to the phone set of character set " mo " by the user.In order to confirm better, they each is distributed to different mode.For example, the phoneme of character string " mo " can be assigned to the single of respective keys and press, and presses for twice and the phoneme of character string " mall " can be assigned on described respective keys.
According to a further embodiment of the invention, the symbol (for example phone set) that causes ambiguity is distributed to the different corresponding modes/operation of for example pressing different buttons.Though clearly, this is inconvenient, and in the above example, first phone set (for example " mo ") can for example be assigned to for example first button of 3308, and second phone set (for example " mall ") can be assigned to another button.
Equally, according to one embodiment of present invention, first phone set with at least one character representation (for example can be assigned to the first action/pattern, utilize respective keys), the beginning phoneme of described first phone set of described character representation, and can be assigned to (for example with respective keys) second action/pattern with second phone set of at least one character representation, and the beginning phoneme of described second phone set of described character representation, like that.For example, press, and twice of can be assigned on same key 3301 or other buttons with the phoneme that the expression character of for example " sh " begins pressed with the phoneme single that can be assigned on the button 3301 of expression character " s " beginning.
According to one embodiment of present invention, can distribute to first pattern/action (for example, utilizing corresponding button) to single letter (for example " a " is to " z "), and can distribute to the second action/pattern to the part of word/word.For example, can press the single that single letter is distributed on the respective keys (for example, say described letter in conjunction with the user), and can press (part of for example, saying described word/word) to twice that the part of word/word is distributed on the respective keys in conjunction with the user.According to this example, the user can make up a part of data input of letter-by-letter data input and word/word.For this reason, on the one hand, when saying described letter, described user can press corresponding to the button that is transfused to letter by single, provide the input of letter-by-letter data, and on the other hand, when saying described word/word a part of, described user can provide a part of data input of word/word by the button of pressing corresponding to a part that is transfused to word/word for twice.
According to one embodiment of present invention, for above-mentioned purpose, the device that button is for example pressed is set.For example, by pressing mode button, system can enter data entry system character by character, and by pressing same button once more or pressing other buttons, system can enter a part of data entry system of word/word.According to present embodiment, in corresponding modes, the user can for example press the part of action input character or word/word by the single on respective keys, and says the part of corresponding character (for example letter) or word/word.
Equally, for example according to their right of priority, or usually according to current phrase context, can distribute to different mode to the part of word/word (and obvious, their corresponding phone set) with similar pronunciation.In this case, for example, can distribute to the pattern that single is for example pressed to the part of first word/word, and can distribute to the action that for example twice is pressed on respective keys to the part of second word/word, like that.For example, word " by " and " buy " have similar pronunciation.The user can press the button of distributing to letter " b " and says " bi " and import word " by " by single.Described user can press action for twice and says " bi " and import word " buy " by applying on the button corresponding to letter " b ".Equally, for example, can distribute to for example three-mode of three key tap to syllable/character set " bi " (same, as to say " bi "), like that.Be appreciated that and distribute to the pattern mutual voice of the part of described word/word (for example and significantly, in conjunction with) to the part of at least one described word/word with another button.
As mentioned above, the various combination of the selected character set relevant with the voice of at least a portion of word can corresponding in the dictionary database more than one word.Equally, as mentioned above, for example can use the selecting arrangement of " options button " in the word of those couplings, to select required word.The phrase context that can belong to according to word is distributed to a word to higher-priority (as more than a selected word time).Equally, according to the context of a part/word of the word of at least one front and/or back, higher-priority (as more than a selected word time) is distributed to word.
According to one embodiment of present invention, the part of each described word/word can be distributed to the different mode (for example interactive mode) of data entry system of the present invention.For example, when the user presses corresponding to the button of letter " b " and when saying " be ", can select two words " be " and " bee " by system.According to present embodiment,, for example, can for example distribute to single to first word " be " and press the pattern of pattern, and can distribute to another pattern of for example pressing pattern for twice to second word " bee " for fear of using for example " selection key ".According to this embodiment, in the above example, the user can single presses corresponding to the button of " b " and says " b e ", so that word " be " to be provided.Equally, he can press same key for twice and say " b e ", so that " bee " to be provided.
According to one embodiment of present invention, also can distribute to (for example, mutual) pattern that single is for example pressed pattern or pressed pattern for twice to some problems at interval with button.For example, in the automatic interval procedure, (for example a, the part/word of word) connection/take apart function can be distributed to single is pressed or press pattern twice.According to this embodiment, for example, described imported word/part before and/or afterwards, the part of the word/word that will import of distributing to the pattern of pressing for twice with import word/part and be connected.For example, when the user presses the word of importing word " for " for example by single (for example, saying it simultaneously), before described word (or afterwards or before and afterwards both), space character can be set automatically.If, then can be connected the part of described word, perhaps be connected with a part at the word/word that is transfused to thereafter with the word/word of front by pressing (for example and say it) input same word for twice.
In the above example, same, for example, press for twice after the part of input word/word and may cause identical result.
According to some embodiments of the invention, for automatic purpose at interval, a part of distributing to some word/words of corresponding phone set can comprise at least one space character at their end.In this case, when not needing described space, it can be deleted automatically by system.Can (for example, pass through system) and be positioned at the Portugal in described space at the character of for example punctuation mark of the end of word input.For example:
" word " back is that ", " produces " word, "
According to a further embodiment of the invention, for automatic purpose at interval, a part of distributing to some word/words of corresponding phone set can begin the place at them and comprise at least one space bar.In this case, when not needing described space (for example) for first word of delegation, can by system-kill it.Because space character is positioned at the place that begins of word, so, as usually, can import the character (for example being connected to it) of single letter for example or punctuation mark as usual at the end of word.
According to one embodiment of present invention, comprising, can be provided for connecting the action of pressing when for example predetermined key of the part/word of forward part/word and front/back from maying I ask during the input of the data of process.For example, if provide the space automatically between two (for example current and front) word/parts, then for example the predetermined action pressed of button can be deleted described space, and connects described two word/parts, example:
" for "+" give "+predetermined key is pressed, and produces " forgive "
According to a further embodiment of the invention, the long period is sent the vowel of the part of word/syllable/word, finishes with described vowel, may cause the better process of eliminating ambiguity by speech recognition of the present invention.For example, when saying " vo ", a part of sending word/word that the sound of vowel " o " can reporting system will import for more time is " vo ", is not the part " vol " of for example word/word.
According to one embodiment of present invention, press the preset device of action by for example using predetermined key, the data that import can be capitalized.For example, by pressing " Caps Lock " button, the part of the letters/words/word that is transfused to after this can be with the capitalization I/O.On described " Caps Lock " button another pressed action and can be converted back to little WriteMode to system.Be appreciated that and distribute to spoken pattern to described function (for example " Caps Lock ").For example, for the beginning of capitalization process is provided, the user can press corresponding to the button of " Caps Lock " symbol and send the corresponding voice (for example " Caps " or " lock " or " Caps lock " etc.) of distributing to described symbol.
According to one embodiment of present invention, can distribute to first pattern that for example single is pressed on respective keys (for example in conjunction with/not in conjunction with the voice of the part of described letters/words/word) to the part of the letters/words/word of small letter, and can distribute to second pattern that for example twice is pressed on respective keys (for example in conjunction with/not in conjunction with the voice of the part of described letters/words/word) to the part of the letters/words/word of capitalization.For example, for word (for example character set) " thought " is provided, the user can single pushes button 3301 and say " thought ".In order to produce word " THOUGHT ", described user can push button 3301 and say " thought " for twice.This allows to capitalize partly input.
Equally, according to similar principles, can for example distribute to single to the part of word/word and press pattern, press the pattern isotype for twice with its first letter capitalization and its remainder small letter.
According to one embodiment of present invention, as be used for the input of data character by character before described in the application, can distribute to one action to the part of letters/words/word more than one, for example press two buttons simultaneously.For example, can distribute to the part of the word/word that begins with " th " to press simultaneously and distribute to letter " t " and " h " two different buttons respectively, and (finally) says the part of described word/word.Identical principle can be distributed to the part of the word/word that begins with " ch ", " sh " or alphabetic(al) any other letter (for example " a ", " b " etc.).
According to one embodiment of present invention, the part of the word/word that can begin the phoneme by character representation is distributed to first pattern that single is for example pressed respective keys, and the part of the word/word that is begun by the phoneme more than a character representation can be assigned to second pattern of for example pressing respective keys (it can be different button) for twice.For example, can distribute to single to the part of the word/word that begins with " t " and (for example press respective keys, combine with the voice of described word), press described respective keys for twice or press another button (for example, combining) for twice and can be assigned to the voice of described word with the part of word/word of " th " beginning.
As mentioned above, different embodiment according to the subject invention, in one or more language, in the variety classes of the different dictionaries of for example word lexicon, can use the dictionary of the part (character set) of syllable/word, the dictionary of speech pattern (for example part of syllable/word) etc.If desired, can the two or more dictionaries in every kind or all kinds be merged.The dictionary that for example, can merge the part of the dictionary of word and word.
As mentioned above, data entry system of the present invention can use any keyboard, and can be used for for example many data entry systems such as " many buttons " system, word forecast system, dummy keyboard.For example, on the one hand, the user can not say the content (that for example is accustomed to is such) of input by the button of pressing corresponding keyboard in described system, use described other system input text (for example letter, word), and on the other hand, described user can be by pressing respective keys and saying the described data (part of mail, word/word for example, if and so design, for example other characters of punctuation mark etc.) import for example data of text (for example part of letter, word/word).
As mentioned above, data entry system of the present invention can use any sound/speech recognition system and method, is used to discern the spoken symbol of the part, phrase etc. of for example character, word-word.Native system also can use for example labiomaney, eye other recognition systems such as to read, and the user action recognition system that moves identification (for example by the use camera) etc. with different mode, finger identification, fingerprint recognition, finger that for example button is pressed combines.These recognition systems and user's action was described in by the patented claim before the inventor submitted to.All characteristics in the application before described can be applied to grand (for example the pursuing the part of word/word) of data entry system of the present invention.
According to a further embodiment of the invention, (as described in the application before the input stage character by character) system can be designed such that for input text, the user can say the part of word/word and not press respective keys.On the other hand, described user can push button, and is used for the end/beginning of reporting system voice (for example part of character, word, word, phrase etc.), punctuation mark, function etc.
Data entry system of the present invention for example also can be applied to import grand more than the sequence of a word, or even is applied to the phrase input system.For example, the user can (for example simultaneously) say two words, and presses the button corresponding to the initial of first word of described two words.
Though the application and before many paragraphs of application in, for data input purpose, press the described of example as shown in conjunction with the button of user's sound/speech, data entry system of the present invention also (for example can be applied to other data input devices, and can use other user behavior and corresponding recognition system the object of for example user's that the part of character, word/word etc. can be assigned to finger).For example, the finger that (as what described in the former patented claim of being submitted to by the inventor) system's (by for example using camera) can discern the user moves the space, rather than (or in conjunction with) the pressing action on the keyboard is analyzed.For example, the user can knock (for example letter " m, n, o " being distributed to) his right thumb and say " milk " (for example, preferably, right thumb being scheduled to distribute in word " milk ") on desk.In this example, move in conjunction with the described user's of described user's voice finger and can be used to import word " milk ".
In another example and according to same principle, described other data entry devices can be for example user's of letter hand-written symbols (for example scribble), and described behavior can be a user's voice.For example, adopted the device based on pen (for example PDA, stylus etc.) of hand-written discrimination system, user can write for example symbol of letter by use, and said described letter, with the accuracy of the recognition system that improves native system.In another example, described user can write at least one letter corresponding to the first at least phoneme of the voice of the part of word/word, and says the part of described word/word.When described user writing described when letter, the hand-written discrimination system of this device is discerned described letter, and the part of described letter and word-word and/or the phone set of distributing to described at least one letter (or symbol) are associated.When user's sound is heard by system, then this system attempts it and at least one described phone set are complementary.If have phone set and described voice to be complementary in described phone set, then the character set corresponding to described phone set is selected by system.Remaining process (for example, finding out the process of final word) can be similar to the application with by the inventor before process described in the different embodiment of the application submitted to.
According to an embodiment,, can do following summary to the data entry system of the invention described in the application that submits to by the inventor and the former application:
Can give the object of predetermined quantity the allocation of symbols of predetermined quantity, button normally, the alpha-numeric characters of at least a language of described symbolic representation and/or the part of word and/or word, punctuation mark, function etc., described symbol is used in the data of text input system for example, wherein, can by provide with described other information in the predetermined mutual incoming symbol of corresponding object, when other information of existing corresponding to described symbol, described other information are not provided with described object interaction usually, wherein, normally there are the voice corresponding to described symbol in described other information, and are perhaps final, lack described voice.And wherein, described object also can be for example user's finger, user's eyes, the objects such as button of keyboard, and described user behavior can be behaviors such as for example user's voice, user's finger moving direction (do not comprise do not move), user's fingerprint, user's lip or eyes move.
The data entry system that is different from other, wherein, many buttons are pressed and are used to import small numbers of characters, and data entry system of the present invention can use the input that a small amount of button is pressed provides many characters.
The method of configuration symbols on keypad
The distinct methods of configuration symbols has been proposed in the patented claim before submitting to by the inventor.Figure 43 shows the method for allocation of symbols being given the button of keypad 4300.
As mentioned above, alphabetical a-z and digital 0-9 are positioned on the telephong type keypad their normal place, and can be by pressing respective keys and saying them and import.
Similarly, as described above, many punctuation marks and function are assigned to the button of described keypad, and can not say them and import by pressing (or pressing for twice) respective keys.
In this configuration, some punctuation marks of for example "+" of being said naturally by the user numbers 4301 are assigned to some buttons, and can be by pressing respective keys and saying them and import.
Equally according to this layout, for example some symbols of "-" numbers 4302 can be positioned at a button, two positions, and described symbol can have different implication and based on context, pronounce or mute according to the context of data.They with when input they the time symbol that need speak carry out disposable combination, and with make up when importing the symbol that they need not speak.Can the allocation of symbols that need voice be given more than voice according to the context of data.For example, the symbol "-" 4302 of distributing to button 4303 can be imported with different modes.
-user can push button 4303 and say " minus "
-user can push button 4303 and say " dash "
-user can push button 4303 and silent
The indistinct symbol of exchange on the button of keypad
As mentioned above, for example some symbols of letter of distributing to the same key of keypad/keyboard can have roughly similarly pronunciation.This may make sound/speech recognition system of the present invention cause ambiguity.Figure 43 shows standard telephone type keypad 4300.When pressing described button and sending the sound of one of described letter, distribute to a pair of letter " d " of button 4301 and the ambiguity that " e " may cause sound/speech recognition system of the present invention.When send they one of sound the time, a pair of letter " m " and " n " that distribute to adjacent key 4302 also may cause ambiguity.On the other hand, can easily distinguish letter " e " or " d " and letter " m " or " n ".By another right respective keys is distributed in the exchange of one of every pair of letter, the identification problem (for example, the application of the invention presses and the data entry system of speaking) of described four letters will be solved.This may change the numerical order configuration of keypad a little, but will improve the accuracy of data input significantly.Figure 43 b shows the keypad 4310 after described change.
Automatic partitioning method
As mentioned above, the automatic interval procedure that is used to connect/separate a part/word of word can be assigned to the pattern that single is for example pressed pattern or pressed pattern for twice.As has been described, the user can press beginning character/phoneme corresponding to described symbol (in data entry system character by character of the present invention simultaneously by saying described symbol, the normally described symbol of described beginning character) button (for example, the button that described symbol is assigned to), to for example at least the symbol of the part of word (for example, not providing space character) at its end import.According to described process, also for example, the user can press for twice simultaneously corresponding to the described button of the beginning character/phoneme of described symbol and for example imports the symbol of the part of word (for example, comprising space character at its end) at least by saying described symbol.In the many buttons of needs are pressed with the data entry system of importing word, automatically at interval may advantageous particularly.
According to above-mentioned principle, for example, in data entry system character by character of the present invention, by saying/do not say described character, for example single is pressed respective keys simultaneously, and character can be transfused to and be connected with the character of front.Comprise that the same action of pressing action for twice can cause importing described character and it is connected with the character of described front, but also can after current character, add space character.The character late of importing will be positioned at (for example will be connected with described space character) after the described space character.For example, in order to import word " see you ", the user can be at first by saying respective keys that letter " s " and " e " and single press them and input alphabet " s " and " e ".Then, he can say " e " and press its respective keys twice simultaneously.Then, the user can press respective keys and input alphabet " y " and " o " by saying letter " y " and " o " while single.Then, he can say " u " and press respective keys twice.
According to a further embodiment of the invention, system can make described space character be positioned at before the described current character, rather than described space character is positioned at after the described current character.
Be appreciated that after described character or before can consider any other symbol (or symbols), rather than space character.Certainly, as previously mentioned, consider that letter is the part of word, identical process can be applied to a part/word level of the word of data entry system of the present invention.Again for example, the user can be by following step input word " prepare it ", that is, by say " pre " simultaneously for example single press corresponding to the button of letter " p " and at first importation " pre ".Then, the user can press for twice corresponding to the button of letter " p " simultaneously and imports " pare " (for example, being included in the space at its end) by saying " pare ".Then, the user can press for twice corresponding to the button of letter " i " simultaneously and imports word " it " (for example, being included in the space at its end) by saying letter " i ".
The conventional keyboard (QWERTY) of standard on keypad with the button that reduces number
Configuration
According to one embodiment of present invention, can be in configuration of the letter on the keypad and/or distribution according to the configuration of letter on qwerty keyboard.This can attract many people that do not use the telephong type keypad to be used for the data input, and is very simple, for no other reason than that they are unfamiliar with the lexicographic order configuration of letter on the standard telephone keypad.According to one embodiment of present invention, use this keypad that combines with data entry system of the present invention also can provide the better recognition accuracy by sound/speech recognition system of the present invention.
Figure 44 a shows the example of telephong type keypad 4400, wherein, alphabetic character be disposed in according to described letter on its button of the configuration on the qwerty keyboard/distribute to its button according to the configuration of described letter on qwerty keyboard.As shown in the figure, the letter on the top row of qwerty keyboard alphabet key is with the same sequence of described letter on described qwerty keyboard, is distributed on the button 4401-4403 of top row 4404 of described keypad 4400.The letter that is positioned at the qwerty keyboard middle letter row is arranged in same sequence (interrelated) on the qwerty keyboard with described letter, is distributed on the button of second row 4405 of described keypad 4400.And last, the letter on the low alphabetic string of qwerty keyboard is positioned at same sequence on the qwerty keyboard with them, is distributed on the button of the third line 4406 of described keypad 4400.
Continuation is with reference to this embodiment, so that indistinct letter is positioned at the form on the different key, described alphabet letters is distributed on the button of described keypad.Figure 44 b shows the keypad 4407 of the QWERTY layout with minor alteration.In described keypad, eliminating the mode of the ambiguity between letter ' M ' and " Z ", the key assignments of letter ' M ' 4408 and " Z " 4409 is exchanged.In this example, revise the QWERTY configuration a little, still have the described keypad of data entry system of the present invention, can improve recognition accuracy by use.Be appreciated that letter layout and the change that to consider any other.
As shown in the figure, QWERTY keypad of the present invention can comprise for example other symbols such as punctuation mark, numeral, function.By use as the application who submits to by the inventor and before application described in data entry system of the present invention, they are imported.
Must be noted that: have the button that alphabet letters that QWERTY (or any other) arranges can be assigned to any keyboard with the button that reduces number.Data entry system of the present invention can in conjunction with and use described keyboard.Be appreciated that and revise the layout of any standard for better accuracy.
QWERTY on the six press keys arranges
According to one embodiment of present invention, data entry system of the present invention can use keyboard/, wherein, the alphabet letters with QWERTY layout is distributed to the six press keys of described keyboard/.Clearly, according to data entry system principle of the present invention, also can distribute to described button to the part of word/word.
As known, according to the configuration sequence that is called as QWERTY, alphabet letters be arranged in the PC keyboard 3 the row buttons button on.Figure 45 shows qwerty keyboard 4500, wherein, alphabetical A is arranged on the triplex row button 4507,4508,4509 of described keyboard to Z.Usually, the user uses the finger of its both hands to be used for (touch) and knocks described keyboard.By using the finger of his left hand, the button of the letter shown in the user for example knocks on the left side 4501 of described keyboard 4500, and by using the finger of his right hand, the user for example knocks the button of the letter on the right side 4502 that is positioned at described keyboard 4500.According to these principles, can consider that multiply by two row 4501-4502 forms according to triplex row 4507,4508,4509 arranges the button of the letter of qwerty keyboard.
According to one embodiment of present invention, the group of the six press keys of the keyboard that reduces (for example 3 taking advantage of 2) can be used for duplicating the described QWERTY layout of PC keyboard thereon, and is used for data entry system of the present invention.Figure 45 a shows an example, and is preferred, and six press keys is arranged to triplex row 4517-4519 and two row 4511-4512, is used for duplicating described QWERTY thereon and arranges.As example, upper left-hand button 4513 comprises letter " QWERT ", and it is corresponding to the letter on the button in the left side 4501 of the top row 4507 of the qwerty keyboard 4500 that is positioned at Figure 45.Other buttons of the group of described six press keys are followed same principle, and comprise the corresponding letters on the button of the corresponding row and column that is positioned at described PC keyboard.
The user of qwerty keyboard knows the position that each is alphabetical usually definitely.Motor reflex can be imported it fast on qwerty keyboard.As mentioned above, arrange and to make the user can on keyboard, touch-type (input fast) duplicating QWERTY on the six press keys with the button that reduces number.Described user can for example make bimanual thumb (left thumb is used for left column, and right thumb is used for right row) be used for the data input.This looks like on the PC keyboard that allows the rapid data input and carries out button.
The left side and the right side character definition that are appreciated that the keyboard of describing in the example in the above are illustrated as just example.Can rethink described definition according to user's custom.For example, letter " G " can be considered and belong to right side rather than left side.
According to one embodiment of present invention, have that to comprise that the keypad that uses QWERTY to arrange at least 6 buttons of the alphabet letters that button is distributed can be used for character by character of the present invention/by the data entry system of the part of word at least.Except the advantage of having described, described layout also comprises other advantages, for example:
-usually the letter that is positioned on the same key is distinguished by sound/speech recognition system of the present invention
The number of the data input of-pin-point accuracy, the alphabet key that significantly reduces and the layout that described letter is familiar with on described keypad very much are (for example, QWERTY), make the user can rapid data input and do not need often to see the display unit of keypad or relevant device
For accuracy better, can consider change to this layout.For example, Figure 45 b shows the keypad 4520 that the six press keys at least of QWERTY letter layout is used in as implied above having, and wherein, in order to separate letter ' M ' 4522 and letter " N " 4523, has exchanged letter " Z " 4521 and " M " 4522.Be appreciated that this only is example, also can consider other forms of change.
Must be noted that as mentioned above, the QWERTY that distributes to a fewer keys arranges and only is shown and described as example.The keyboard (for example keypad) that other configurations of alphabet letters (in any language) can be assigned in Any shape is gone up the button of any number that is arranged with any key layout form, and is used for the data entry system of pressing and speak of the present invention.Equally, be appreciated that, for example other symbols of punctuation mark, numeral, function etc. can be assigned to described button or comprise other buttons of keypad of button of described letter or other buttons of described keypad, and according to as data entry system of the present invention described in the application of the application who submits to by the inventor and submission in the past import.
According to one embodiment of present invention, the button of lesser number can be used to comprise alphabet letters (with aforesaid other symbols), and is used for the data entry system of pressing and speak of the present invention.Figure 45 C shows the example of four button 4530-4533, and it has the character of the English alphabet of distributing to them.In order to keep the familiarity of this layout, the QWERTY of the letter of two row arranges and is held above the keypad 4520 of Figure 45 b, and, the letter of the minimum row of the described keypad 4520 of Figure 45 b is distributed in following mode in the button of respective column (for example left and right) of described four button 4530-4533, that is, to keep the form of " approximate QWERTY " familiarity of keyboard and the pin-point accuracy of speech recognition system of the present invention.For example, here separately alphabetical " n " 4537 and " m " 4538 also distribute to the right button 4533 and 4532 of keypad 4530 respectively, and letter " n " and letter " m " are positioned at the minimum right button of the keypad 4520 of Figure 45 b.Be appreciated that, for example other symbols of punctuation mark, numeral, function etc. can or comprise on other buttons of keypad of described alphabetic key at described button and distributing, and according in the application and the data entry system of describing in the application of submitting to before by the inventor of the present invention import.
Be appreciated that also recognition accuracy is not affected up to now, even the button of minority can be used to comprise all alphabetic(al) characters, and be used for the data entry system of pressing and speak of the present invention.Two button 4541-4542 of (for example keypad) that Figure 45 d shows that the letter of English alphabet is assigned to.Described keypad can be used for the data entry system of pressing and speak of the present invention, but for letter on the same key with roughly similar pronunciation, may cause ambiguity.
In theory, can distribute to single button to all alphabet letters, but this may greatly reduce recognition accuracy.
Though, push button and say the required symbol of distributing to described button and be enough to be used in importing described symbol, but because for example do not wish to say some reason of some symbol, for example can provide the application and before application in describe, about the certain methods of data entry system of the present invention.Go out as shown, can not say described symbol by pushing button symbol is imported.For example, by with reference to figure 45C, the user can push button 4530 and silent, so that space character to be provided.According to another kind of method, can keep described button to press and press simultaneously second button by pressing first button, symbol is imported.According to another kind of method,, can after the symbol of for example letter, provide for example described special character of space character by before the button that discharges corresponding to described symbol, pressing predetermined key (for example) corresponding to special character.
Be used for data when input when having a fewer keys,, can distribute to that action is pressed in twice of predetermined key to the input of the non-spoken symbol of the frequent use of for example space character and silent for the faster data input.This may be effective, because if space character is distributed to the pattern that single for example presses the button, and for example other spoken characters of letter also are assigned to described button with described pattern, after the spoken character of input, (in order not make sound/speech recognition system fascination) in order to import described space character, and the user has to suspend a bit of time push button (and not sounding) before.Space character is distributed to twice of button press pattern, do not have spoken symbol to be assigned to twice for described button and press pattern, solved this problem.The user presses described button for twice simply and does not have described time-out, rather than stops and pressing described button once.As mentioned above, another solution is to give different buttons spoken with non-spoken allocation of symbols, but this may need more buttons.
Equally, be appreciated that as here-above-described key groups on the QWERTY of letter arrange and be provided as example.Can consider the button of for example alphabetic order, other numbers or other symbols configurations of any key layout.For example, according to one embodiment of present invention, keypad can comprise two buttons of the letter that is used to distribute the most frequent use, and described keypad can have other two buttons that the letter that does not more frequently use is distributed to.
Now, allow most of electronic equipments of data input to be equipped with the telephong type keypad.Can be to the button of telephong type keypad the configuration of aforesaid alphabet letters and dispensing applications.
Figure 46 a shows the example of telephong type keypad 4600, wherein, the alphabet letters (for example, as mentioned above) with QWERTY configuration is distributed to the six press keys of two adjacent column 4601,4602 of described keypad.Owing to be in adjacent column, the letter input by a hand (thumb) becomes and is more prone to.Similarly, as described above, the user can use his two thumbs (for example left thumb is used for left column, and right thumb is used for right row) to be used for the rapid data input.Be appreciated that for example other symbols of punctuation mark, numeral, function etc. can distribute on the button of described keypad, and according to importing as the data entry system of describing in the application and the application by inventor's submission in the past.
Figure 46 b shows another kind of telephong type keypad 4610, wherein, the alphabet letters with QWERTY configuration is distributed to the six press keys of row 4611,4612 of two outsides of described keypad.Owing to be in the row of two outsides, the letter input by two hands (thumb) becomes and is more prone to.Equally, as mentioned above, the user can use a hand to be used for the data input.In this example, in order to improve the accuracy of sound/speech recognition system of the present invention, small modification is employed.For example, on corresponding button 4613,4614, exchange letter " m " and " k ", be used to avoid the ambiguity between alphabetical " m " and " k ".Equally, on corresponding button, exchange letter " f " and " z ", be used to avoid the ambiguity between alphabetical " f " and " z ".Be appreciated that other variations in considering to dispose.For the faster data input, a plurality of buttons 4615,4616 distributed in some characters of for example space character.
Figure 46 C shows another kind of telephong type keypad 4620, wherein, arranges four buttons that are assigned to described keypad based on above-mentioned principle and in the alphabet letters shown in Figure 45 C.
Be appreciated that the letter that QWERTY arranges on minority at the keyboard of for example keypad (for example 6,4,2 the etc.) button is described as example.For example the letter of the alphabetic order other types of arranging also can be considered, and for example are assigned to a fewer keys of a button such as 2/3/4/5/6.
Clearly, all data entry systems of the present invention (with they respective application) that a part of data entry system of word/word was imported and/or pursued to data character by character for example of the present invention can use the above-mentioned keypad of just having described (for example, having for example a fewer keys of 4 to 6 buttons).
Individual's mobile computer/telecommunication apparatus
The portability that mobile device must be small enough to provide convenience.Need the desirable mobile device of data (for example text) inputs and/or data communication must have little data input cell (for example, at the most, a fewer keys only) and big (for example wide) display.
The ability of the layout of alphabet letters on a fewer keys (with other symbols) and the input of partial data fast and accurately that provided by the data entry system of the present invention by described a fewer keys can allow to rethink the design of some current productions, is used to make them more effective.
One of these products are mobile phones, and it is used to for example task of textcommunication and the Internet at present, and are become mobile computing device by prophesy.Mobile phone to reality designs opposite with above-mentioned principle.This need use many buttons because of mobile phone (complexity) data entry system, makes telephonic roughly surface, and slow data input is provided, and stays less zone for small-sized (for example narrow) display unit.
One of application that computing machine the most generally uses is the word processing procedure.Follow the use of the Internet, write the application of the most generally using that letter also will become mobile computer/communication facilities.The display that described application need is wide, with allow in its whole width, to draft, massaging and browsing document.For example, when editor's letter, the user must see described document in its whole width, and must not be rolled to the left side or the right to it.
According to one embodiment of present invention, can provide the electronic equipment that comprises wide display and little data input cell, has for example mobile computing/communication facilities of rapid data input capability.Figure 47 a shows the mobile computing/communication facilities 4700 with two row buttons 4701,4702, wherein, alphabet letters (for example, preferably, have above-mentioned QWERTY and arrange) is distributed to them.As mentioned above, for example other symbols such as numeral, punctuation mark, function are also distributed to described button (or other buttons).The described button of described communication facilities can be pressed and the data entry system of speaking combines with of the present invention, so that complete fast data input to be provided.Use a fewer keys (for example, having only two row) to be used for the data input, allow integrated wide display 4703 in described equipment.(clearly, described display unit can be similar to be the width of A4 paper to) width to described mobile device, so that the document of approximate full-size(d) (for example width) to be provided, is used to browse.Described mobile computing/communication facilities also can have for example other buttons of button 4704,4705, for example is used for up/down, left/right rolling document, at described display 4703 cursor 4706 is navigated, sends/end functions etc.Equally, described equipment can comprise mouse in for example its rear side or any other side.At a plurality of applications of submitting to by the inventor (for example " pen-based computer " and " being used for strengthening the feature (Features toEnhance Data Entry) of data input "), described in display and other data and imported mouse on intensifiers/browse problem.Described problem/the feature of all of described application can be carried out combination between them, and/or combines with data entry system of the present invention and data communications equipment.
Continue to describe Figure 47 a, the layout of button allows the user to use his both hands to carry out thumb input when holding described equipment 4700 in two row 4701,4702 on the left side of described communication facilities 4700 and right side.Be appreciated that other configurations and other symbols on other layouts of button on the described equipment that to consider letter.For example, equipment can comprise a fewer keys of arranging with delegation only, wherein, described symbol (for example letter) is distributed to them.
Similarly, as described above and described in corresponding patented claim, by rear side the mouse (not shown) is set at described equipment, wherein, preferably, the button of described mouse is in the opposition side (for example front side) of described electronic equipment, the user can use for example his forefinger, is used to operate described mouse and uses its thumb to press relevant button simultaneously.
Equally, as mentioned above, can use described equipment as phone.It can comprise at least one microphone 4707 and at least one loudspeaker 4708.Distance between the position of the above microphone of described equipment and described loudspeaker can be corresponding to the distance between mouse and user's the ear.
Figure 47 b shows the example of the equipment 4710 of the equipment that is similar to Figure 47, wherein, its input block includes only four buttons arranging with two row 4711,4712, and wherein, alphabet letters and common numeral are distributed to described button according to the principle of having described.Other symbols and function (not shown) also can be distributed to described button and/or other buttons according to the principle of having described.The user can use his two thumbs 4713,4714, is used for input.
Figure 47 C shows the equipment 4720 of the equipment that is similar to Figure 47 b, wherein, its input block includes only four buttons arranging with two row 4721,4722, this two row is positioned at a side of described electronic equipment, wherein, alphabet letters and common numeral can be assigned to described button according to the principle of having described.Other symbols and function (not shown) also can be distributed to described button and/or other buttons according to the principle of having described.The user can use a hand (or both hands), is used for the data input.Center in the layout of described four buttons can be provided with lug boss 4723, is used to allow the data input and need not sees keypad.
Figure 47 d shows the equipment 4730 of the equipment that is similar to Figure 47 c, wherein, its input block comprises four buttons arranging with two row 4731,4732, this two row is positioned at a side of described electronic equipment, wherein, alphabet letters and common numeral can be distributed to described button according to the principle of having described.One of described first two row button (in this example, 4731) the third line button 4733 that duplicates is positioned at the opposite ends of described electronic equipment 4730.This layout of button allows the user to use the selection as him of a hand or two hands, with the input data.Other symbols and function (not shown) also can be distributed to described button and/or other buttons according to the principle of having described.
Figure 47 e shows the example that designs and be similar to the electronic equipment 4740 of previous embodiment according to the principle of describing among the application, difference is, when needs, extensible/collapsible/folding display 4741 can be set, in the described electronic equipment to allow large-scale demonstration.For example, by using Organic Light Emitting Diode (OLED) display, described electronic installation can be equipped with the extendible display of monolithic (one-piece).Be appreciated that described display can extend with the need.For example, described display unit can launch repeatedly, is used to provide big display.It also can be a rotation/non rotatable display unit, so that extend with the need.The button that is appreciated that described data entry system of the present invention can be a soft-key button, and its surface at the described display unit of described electronic equipment is implemented.
According to one embodiment of present invention, shown in Figure 47 f, for example the electronic equipment 4750 of electronic equipment described above can be included in its inner integrated print unit (not shown).Though described equipment can have any width, preferred, described design of electronic devices (for example, in this example, having the width of approximate A4 paper) can be for example to use that the printing/scanning/copy cell of A4 paper can be integrated in the described equipment.For example, user's A4 paper 4751 of can packing into is with printer page.
Providing total solution to mobile computing/communication facilities may be very useful in many cases.For example, the user can edit and prints them immediately the document of for example mail.Equally for example, the businessman can edit the document of for example invoice under the client agrees and print it, is used for paying immediately.
In order to allow to reduce the size of described mobile computing/communication facilities and still can print for example standard size paper of A4 paper, can provide equipment corresponding to a half-size scale of described standard size paper.
Figure 47 g shows for example standard blank document 4760 of A4 paper.Shown in Figure 47 h, described paper can be folded therebetween, and two and half surfaces 4761,4762 are provided.Shown in Figure 47 i, can be the described folded documents 4771 for example print unit of the electronic equipment 4770 of mobile computing/communication facilities of the present invention of packing into, on two half surface 4761,4762, to print for example document file page of editor's mail, provide the standard size form letter.This will allow to make the undersized mobile electronic device that can print the standard size document.
Circular keyboard
According to one embodiment of present invention, keypad can be positioned on the described keypad with the mode that produces circular formula to the small part button.Figure 48 shows and comprises the keypad 4800 that is positioned at center button 4807 six press keys 4801-4806 on every side.Described center button can be than described other 6 key shape differences.For example, described center button 4807 can be greater than other buttons, or have lug boss on it.Alphabet letters with for example QWERTY configuration can distribute in described button.Can distribute to the button 4807 that is positioned at the center to space character.Certainly, described button can also comprise described and by employed for example other symbols of numeral, punctuation mark, function etc. of data entry system of the present invention as application described above and former among the application.The advantage of this on keypad (for example circular) key layout is that by touching described center button described center button is discerned, the user can beat described button and not see keypad.
Wrist communication device
Data entry system of the present invention can allow to produce has miniaturized electronics complete, the fast data input capability.A kind of promising following telecommunication apparatus is a Wrist communication device.Many effort have been carried out to produce wrist communication/organizer (organizer) equipment that to work.The subject matter of this equipment is the relative fast data input system that can work.Some manufacturers provide the model machine that uses the wrist phone of sound/speech recognition technology, are used for the data input.Certainly, the restriction of the hardware and software of this equipment provides bad data input results.As described in the application of submitting in the application and before by the inventor, data entry system of the present invention combines and can address this problem with the use of a fewer keys, and allows the rapid data on very small-sized equipment to import.Figure 49 shows and comprises that a fewer keys (for example, in this example, be arranged in four buttons of two row 4901,4902) the example of wrist electronic equipment 4900, wherein, for example the symbol of alphabet letters, numeral, punctuation mark etc. is assigned to described button according to the principle of data entry system of the present invention.Described electronic equipment also comprises the data entry system of the present invention that uses described button at least.Described button can be for example to be similar to any kinds such as the conventional button of mobile phone or touch-sensitive type.The touch-sensitive button can allow to use two fingers 4903,4904 of a hand to touch input.Also display unit 4905 be can provide, the data of input, the data of reception etc. are used to browse.Also can assemble observation unit 4906 and described wrist equipment.Described wrist unit also can comprise for example other buttons of 4907,4908, is used for for example sending, function such as end.Must be noted that for the faster data input, the user can take off wrist unit and use two thumbs from his wrist, each thumb is used for the button by the next line button.Be appreciated that the button (for example, aforesaid 6 buttons) that to consider other numbers and other key layout (for example, as mentioned above, Yuan Xing key layout for example).
Also be appreciated that the design of the other types that can consider to be used for wrist communication/organizer's equipment.For example, shown in Figure 49 a, wrist equipment 4910 can be provided with flip potion 4911.Described equipment 4910 can for example comprise the most of buttons 4913 that are used for data inputs, and describedly renovates 4911 and can comprise display unit 4912 (perhaps, vice versa).Shown in Figure 49 b,, the display unit 4921 of observation unit can be installed at the described opposite side of renovating.In the position of closing, described wrist equipment can be similar and as watch.
Be appreciated that the above wrist unit that illustrates and describe only is illustrated as example.Can need use a fewer keys only of the present invention be pressed and the wrist equipment of the other types of the data entry system of speaking is considered to having.For example, shown in Figure 50 a, the Wrist communication device 5000 that comprises the data entry system of the present invention that uses a fewer keys 5003 can be dismountable-can be connected to/can be integrated into the wrist strap 5001 of observation unit 5002.Figure 50 b shows one 5000 the wrist equipment 5010 that is similar to Figure 50 a, and difference is, display unit 5011 and data input button 5012 are separated, and lay respectively at renovate 5013 and equipment body 5014 on.Be noted that described button and described observation unit can be with the wrist of relative relation around the user.
As mentioned above, data entry system of the present invention can be integrated in the equipment with a fewer keys.PDA is an electronic organizers of often using hand-written discrimination system or small-sized virtual qwerty keyboard, and wherein, two methods have to be provided slowly and the major defect of disappointed data input process.Usually, most of PDA equipment comprise at least four buttons.Data entry system of the present invention can use described button according to principle described above, is used to PDA equipment that rapid and precise data input is provided.For example other equipment of dull and stereotyped (Tablet) computing machine also can use data entry system of the present invention.Equally, for example, according to another kind of method, as described, can be on the display unit of for example electronic equipment such as PDA, flat computer for example minority shown in Figure 49 a virtual greatly (for example soft) button (for example 4,5,6,8 etc.) be designed, and these buttons are used for data entry system of the present invention.As example, on the big display of the display unit of for example flat computer the layout of button and configuration can be similar to as Figure 47 a-47d shown those.
The mobile tracking that is used for the data input
For example symbols such as alphabet letters, numeral, punctuation mark, function are divided into minority group and use of the present invention press and the system of speaking uses them, this allows for example mobile other user behavior recognition systems replacement buttons of discerning of user to be pressed action by final use, thereby can eliminate the use that button is pressed action.Described move can be for example user's the moving of finger, eyes, face etc.This may be very beneficial for having the user of finite motion ability, or in the environment of the data entry system that need be interrupted more.For example, can consider four moving directions at the user's body position of for example one or more fingers or its eyes, rather than use four buttons.
According to one embodiment of present invention, by with reference to figure 45C and consider that the symbol of data entry system is disposed in four zones as an example, the user can be his eyes (or under the situation of face tracking system, his face, or under the situation of finger tracker, his finger) moves to upper right and say " Y ", be used to import described letter.Identical mobilely and silent can be assigned to for example punctuation mark ". " 4535.For input alphabet " s ", the user can be to moving his eyes and say " S " than the lower curtate left side.By only use minority clear/user of easily identification moves, it is assigned to a few symbols group that combines with (data entry system of the present invention) feature of for example saying required symbol, and data entry system of the present invention will provide rapid and precise data input and not need hardware manufacturing (for example button).Be noted that in the present embodiment the predetermined button that can replace among other embodiment that moves at user's body position is pressed.All the other processes of data entry system of the present invention as before.
Be appreciated that described in former application, can use other objects of for example responsive keypad or user's finger, and not use button, be used for giving them the sub-set of dispense of described symbol.For example, in order to import required symbol, the user can knock (described symbol is assigned with) finger on the table and say and distribute to described finger and described mobile described letter.Equally, can use other the user behavior and/or the behavior recognition system of for example labiomaney system, and nonrecognition user's sound (for example voice).
A subject matter of a part of rank of word at least of the present invention (for example syllable rank) data input is, if there is external noise, and the voice of the part of described word finish with vowel, then described voice are discerned in this system's possible errors, and provide usually corresponding to the beginning of required part and the output that finishes with consonant.For example, if the user say " mo " (press simultaneously corresponding to the letter " m " button the time), this system for example may provide the output of " mall ".In order to eliminate this problem, data entry system of the present invention can be used certain methods.
According to one embodiment of present invention, as mentioning in the past, the part of the word/word that finishes with vowel articulation can with have the similar word/part that begins to pronounce but finish and be classified as a class with consonant.After input described word/part, dictionary comparison and phrase structure will determine what the required part that will be transfused to is.For example, the part " mo " and " mall " that distribute to the word/word of same key also are sorted in the identical type, mean as the user and press described button and say " mo " or when " mall ", under every kind of described situation, system considers the respective symbols collection of two phone set.This is because should consider that the pronunciation (particularly in noisy environment) of described two phone set " mo " and " mall " is roughly similar, and may be by the sound recognition system wrong identification.
According to one embodiment of present invention, keypad can be used to a part of rank (for example syllable rank) data entry system of word at least of the present invention at least, and wherein, alphabet letters is disposed on the two row buttons of keypad keys for example.
Figure 51 shows the example of keypad 5100, and wherein, alphabet letters is disposed on two row buttons 5101 and 5102.Described layout makes the letter/phoneme position with approximate pronunciation on different buttons.Described layout is also arranged QWERTY and is carried out some modifications.In this example, middle column does not comprise alphabetic character.As mentioned above, a part of rank of word at least of the present invention (for example syllable rank) distinct methods of data entry system can use the keypad of described type, or use as at Figure 45 a to other keypads as shown in the figure of the front of 45d, that have a fewer keys.
As mentioned above, according to one embodiment of present invention, if the part of word/word finishes with vowel, the user can press the button corresponding to the described keypad of the beginning phoneme/letter of the part of described word/word, and say the part of described word/word, be used to import it.If necessary, for more information about described part are provided, the user can press other buttons corresponding to the described part of at least a portion that constitutes letter.For example, if the part of described word/word finishes with consonant phoneme, the user can press other buttons corresponding to described consonant.
Distinguish between pressing corresponding to the button of the beginning letter/phoneme of the part of word/word and pressing for the permission system, the distinct methods of for example after this describing can be provided corresponding to the button of the last letter/phoneme of the part of for example described word/word.
According to one embodiment of present invention, when the user presses when saying it simultaneously corresponding to first button of the beginning phoneme/letter of the part of word/word, he can keep described button to be pressed, and press other button at least corresponding to (preferred, be last consonant) another letter of the part of described word/word.
If described another letter is positioned on the identical beginning button, the user can double-click the part that described button is said described word/word simultaneously.
Figure 51 a shows keypad 5110, and wherein, alphabetic characters (illustrating with capitalization) is disposed on the two row buttons 5111,5112.Each the described button that comprises described alphabetic characters also comprises the alphabetic characters (illustrating with small letter) of distributing to the relative button of going together mutually.According to one embodiment of present invention, when the user attempts importing word/word a part of, he presses corresponding to described and (for example is printed as capitalization, on described button, print off with capitalization) the button of beginning character/phoneme of a part of word/word, and say the part of described word/word.If described user is desirable to provide the more information of for example pressing corresponding to other alphabetical buttons of the part of described word/word, (keep described first button to press simultaneously,) described user can press the button that lists relatively that is positioned at corresponding to described (for example, printing off with upper case or lower case) other letters of the part of described word/word on the button of described relative row.For example, if the user wishes to import word " fund ", he at first pushes button 5113 and say described word, and (when keeping described button 5113 to press) described user for example presses two other buttons 5114 and 5115 corresponding to consonant " n " and " d " continuously.
Figure 51 shows the keypad 5120 of the keypad of similar Figure 51 a, difference is, two row 5121 and 5122 here are assigned to the letter/phoneme corresponding to the beginning phoneme/letter of the part of word/word, and few by being pressed to corresponding at least one the alphabetical button except the beginning letter of the part of described word/word, use other row 5123 that more information about the part of described word/word is provided.This can allow only to use the data input of a hand.For example, if the user wishes to import word " fund ", he at first pushes button 5124 and say described word, and (after discharging described button 5124) described user for example presses two other buttons 5125 and 5126 corresponding to consonant " n " and " d " continuously.
According to a further embodiment of the invention, as mentioned above, can give the object/button of first predetermined number allocation of symbols that needs voice (being used to import them), and being assigned to the button of another predetermined number without the symbol that voice are imported, its button with described first predetermined number separates.
According to a further embodiment of the invention, if provide the button of letter to include only spoken symbol, then the user can press the button corresponding to the initial/phoneme of the part of described word/word, and preferred, says the part of described word/word simultaneously.Then, he can press corresponding to other buttons of other letters of a part that constitutes described word/word and mute.System identification goes out, do not have the button of voice press corresponding to other relevant information of other letters of the part of described word/word.For example, by reference Figure 51, and consider only the button of letter to be provided to described keypad spoken allocation of symbols, if the user wishes to import word " fund ", he at first presses corresponding to the button of letter " f " and says " fund " simultaneously, and after discharging described button, described user for example presses continuously corresponding to two other buttons of letter " n " and " d " and silent.
As mentioned above, a part of data entry system of word/word of the present invention also can carry out work under the step that dictionary of the selected character set of combination and the part of word/word is not compared.The user can pursue and partly import word, and they directly are transfused to.As mentioned above, this is useful to the part with different language input word/word, and does not worry whether they exist in the part of word/word.For example the device of mode key can be used to reporting system, does not have the combining characters collection of described comparison will be transfused to/export.If produced, can be shown to user's (for example, in the tabulation that display shows) to them, and the user can one of them be selected to them by for example pressing " select " button more than a combining characters collection.In another embodiment, if produced more than a combining characters collection, by entering into a part of for example importing next word/word, punctuation mark, the function etc. of " enter " for example, can import combining characters collection automatically with limit priority.
Equally, according to the described principle of having described among the application, can word be imported by having/do not have the step that compares with word lexicon by partly importing.Equally, as mentioned above, described part can be the character set (grand) of character or word.
According to one embodiment of present invention, except alphabet letters, data entry system character by character of the present invention can use the part (for example " tion ", " ing ", " sion ", " ment ", " ship ", " ed " etc.) of the word of a limited number of frequent use and/or the word (for example " the ", " and ", " will " etc.) of a limited number of frequent use, is used to provide the rapid and precise data entry system that needs small amount of memory and faster processing.As described in,, the part of described a limited number of word/word is distributed to the respective keys of keypad according to the principle of data entry system of the present invention in the application of the application and submission in the past.Equally, clearly, as described in the application of the application and submission in the past, they can data entry system principle according to the present invention be imported.According to this embodiment, for example, the user can import word " portion " with four parts " p ", " o ", " r " and " tion ".For this reason, for example by using the keypad of Figure 45 C, described user may at first say " p " also (preferred, almost simultaneously) press corresponding button 4533.Then, he can say " o " also (preferred, almost simultaneously) press corresponding button 4533.Then, described user can say " r " also (preferred, almost simultaneously) press corresponding button 4530.And it is last, he (for example can say " shen ", the pronunciation of the part of word " tion ") also (preferred, almost simultaneously) presses (for example corresponding to letter " t ", the initial of the part of word " tion ") button 4530 that part " tion " is distributed to.
As mentioned above, can use/need not this embodiment of the present invention be handled as the aforesaid step that the word of input word and word lexicon is compared in this application.Under the situation of not using described comparison step, can pursue partly I/O data.As mentioned above, this embodiment of the present invention helps integrated data entry system of the present invention in mini-plant (for example wrist strap electronic equipment, mobile phone), and wherein, memory capacity and processor speed are restricted.Except the described tabulation of the part of (or replace) frequent word/word that uses, the user also can add the part of word/word that he likes in the described tabulation to.
As mentioned above, data entry system of the present invention can use a fewer keys, is used for complete data input.Be appreciated that, single multi-mode/many parts button with different predetermined portions can be provided, rather than described a fewer keys, wherein, each part is carried out different responses to the user action/contact of user on described each described different predetermined portions of described multi-mode/many parts button, wherein, can as distribute in character/phone set of the present invention/character set have as described in predetermined portions as described in action/contact.Figure 52 shows the example (for example similar many/mode button that uses) of multi-mode/many parts button 5200 in many electronic games, mobile phone, TV remote controllers etc., wherein, each of five of described button part 5201-5205 differently responds finger movement (for example the pressing)/contact of user on described part.For example, can distribute to four described part 5201-5204 to different alphabetic characters and punctuate, and can distribute to center section 5205 to space character.Be appreciated that described button 5200 has for example oval-shaped difformity, and can have the part of different numbers that wherein, different symbol configurations can be assigned to each described part.
As mentioned above, and, can provide the electronic equipment that comprises wide display and small data input block, has for example mobile computing/communication facilities of the rapid data input capability that causes by data entry system of the present invention as shown to the example of 47i at Figure 47 a.Similarly, as described above, described electronic equipment can comprise other buttons.Figure 53 shows electronic equipment 5300, it comprise be used for input text and corresponding function button 5302,5303 (in this example, bi-directional key), and other button rows 5304,5305, be used for that input is for example dialed the number (for example, not saying described numeral), other functions of navigation, transmission/receipt of call etc. in display.As described in the present invention, a class symbol that is used for the input of text at least can be assigned to presses for example each side of the bi-directional key of button 5302-5303.A bi-directional key can be corresponding to two independent buttons.Operating a bi-directional key may be easier than two independent buttons of operation.In the example of this embodiment, the user can be by making bimanual thumb 5306,5307 input data.
Described in the application of submitting at the different paragraphs of present patent application and before by the inventor, be appreciated that data entry system of the present invention can use the button of the other types of for example virtual (soft) button.Equally, other data input characteristics described in the application of submitting in present patent application and before by the inventor can be integrated in computing machine/telecommunication apparatus of the present invention to small part.For example, as mentioned previously, can implement extendible (for example dismountable) microphone/camera/antenna 5301 and the mouse (not shown) in described equipment rear side, wherein, the respective keys of mouse is on the front side or any other side of described computing machine/telecommunication apparatus.
As mentioned above, the part available to complete data input/all symbol can be assigned to a fewer keys, and is used for data entry system of the present invention, so that complete fast easy data input is provided.Described a fewer keys can be the part button of keypad.Figure 54 shows another example of the allocation of symbols of PC keyboard being given a fewer keys 5400.In this example, the arrow that is used at display (for example at text) navigation cursor is distributed to spoken pattern.For example, the user can click button 5401 and say " left ", is used for (in the text that for example, demonstrates on display) cursor is moved to the left a character.For cursor being moved to the left several characters, described user can push button 5401, says " left " simultaneously, and keeps described button to be pressed.Cursor can keep being moved to the left, and discharges described button 5401 up to the user.For described cursor is moved right, the user can push button and 5402 for example say " right " simultaneously, and uses the process of just having described.Can use similar process, be used in text, moving up and down cursor by pressing corresponding button and saying corresponding word.
According to one embodiment of present invention, (for example left and right, upper and lower) moving cursor can be assigned at least one button on a plurality of directions.Continuation is with reference to Figure 54, and as example, moving cursor can be assigned to single button 5403 on different directions.For example, the user can push button 5403 and say " left ", and described cursor is moved to the left.For make cursor to the right, go up or move down, described user can push button 5403 and say " right ", " up " or " down " respectively.
Be appreciated that in this example (for the available part of complete data input/all symbol can be assigned to) number of keys only is illustrated as example.According to the needs of for example electronic device design, described number of keys can be different.
According to one embodiment of present invention, the keypad/data input cell of the present invention with a fewer keys can comprise for example other features such as microphone, loudspeaker, camera.Described keypad can be the separate unit that is connected to respective electronic equipment.Described independent keypad can allow the display unit of the whole side of the described electronic equipment of integrated basic covering.Figure 55 a shows the independent keypad 5500 with a fewer keys at least (or at least corresponding to multidirectional key of described a fewer keys) 5501,5507,5508,5509 of the present invention, be assigned to described a fewer keys for complete available part/all symbols of data input, be used for data (for example text) input.Described keypad also can comprise for example other features such as microphone 5502, loudspeaker 5505, camera 5503.Described other features can be integrated in the described keypad, or tie mutually with it/link to each other etc.Shown in Figure 55 b, described keypad 5500 (representing by outboard profile) can comprise ties device 5504, is used for described keypad is tied for example another object of finger/wrist of user.Described keypad can (wirelessly or pass through lead) be connected on the corresponding electronic device.Figure 55 C shows the independent keypad 5510 according to the principle of just having described.As mentioned above, by using a fewer keys that combines with data entry system of the present invention, be used for the partial data input, after the training of short time, the user can import for example data of text by described a fewer keys, and need not see described button.Based on this principle, the user can be held in described keypad 5510 in its hand (for example palm) 5511, make its near mouthful position (hand by making him is near his mouth), and according to the principle of data entry system of the present invention, press required button and silent/say this symbol (for example part of the character of pressing corresponding to described button, letter, word/word, function), and need not see described button.As mentioned above, described keypad can wirelessly or be wired on the corresponding electronic device.In this example, keypad is connected on the corresponding apparatus (not shown) by lead 5512.Equally, in this example, microphone 5513 is tied on the described lead 5512.Described keypad 5510 is placed near being used for the data input in the hand (for example palm) of mouth, has many advantages, for example:
-user does not need to be with and wears overhead microphone
-described user can speak near microphone very much, so he can speak discontinuously
User's sound may be increased the weight of in the cavity of-user palm, is used for receiving better by microphone
-user's hand (for example palm) is roughly eliminated the external noise when speaking
-user's hand (for example palm) prevents that user's sound from being spread (for example, not disturbing others)
Be appreciated that independent keypad/data input cell of the present invention also can be included in the application and the application submitted in the past by the inventor described in part/all features.For example, described independent keypad/data input cell can comprise camera, for example is used for labiomaney of the present invention system.It can also comprise the device based on tooth recognition system of the present invention.Other features of described keypad can also comprise battery for example, link to each other described keypad with corresponding device thereof wireless device.Utilize described keypad also can implement antenna.Under the situation that lead connects, described lead can also comprise the antenna system of keypad and/or respective electronic equipment.
According to one embodiment of present invention, shown in Figure 55 d, independent keypad 5520 of the present invention can be used as necklace/pendent.This make the use of keypad/data input cell of the present invention can be easily, interruption, portable.
According to one embodiment of present invention, shown in Figure 55 e, independent keypad 5530 of the present invention can tie with the pen of the touch-sensitive display of the display of the dull and stereotyped PC of PDA/ for example/and integrated.This make the use of keypad/data input cell of the present invention can be easily, interruption, portable.
According to one embodiment of present invention, shown in Figure 55 f, the keypad of the present invention with a fewer keys can be many parts keypad 5540 (being illustrated with approaching position).The size that this will allow to reduce more described keypad allows to provide very undersized keypad, by this keypad, provides complete data input.Many parts keypad is by inventor's invention, and patented claim is submitted to.Described in the described application some/all descriptions and feature be applied in many parts keypad of the present invention with a fewer keys.
According to one embodiment of present invention, shown in Figure 55 g, have the keypad/data input cell of the present invention of a fewer keys 5550 and in the rear side (or other sides) of described keypad, can comprise indicating member (for example mouse).Described indicating member can be for example plate 5551 or any kind of ball-type (not shown).The button of described indicating member can be positioned at the front side of described data input cell.Be positioned at for example click of a side of data input cell rear side (for example mouse) unit by inventor's invention, and therefore submitted patented claim to.Described in the described application some/all descriptions and feature can be applied in many parts keypad of the present invention with a fewer keys.For example, at least one button of described keypad also can resemble works the button of described indicating member, and described indicating member is positioned at the rear side of described keypad.
Figure 55 h shows the data input device of the present invention 5560 of the data input cell 5561 that comprises a fewer keys 5565-5568.Described device also has click (for example mouse) unit, is used for combining with described data input cell carrying out work, is used for complete data input and service data.Described device and it the mobile computer mouse point device that can be similar to routine from the teeth outwards.Described integrating device can be wirelessly or is connected to by lead 5562 on the respective electronic equipment of computing machine for example.Shown in Figure 55 i, indication (for example mouse) unit 5569 can be positioned at a side of for example described described data input cell 5561 (not shown, as to be positioned at the opposite side of described device) rear side here.Described indication (for example mouse) unit 5569 can be the mouse of spin type.The computing machine of the described integrated data input media 5560 that the user can combine with data entry system of the present invention with use is operated/is worked, and integrated data input media 5560 replaces conventional PC keyboard and mouse.Mousebutton can be 5563,6664 a conventional button (referring to Figure 55 h) for example, or the described a fewer keys that their function is distributed to described data input cell 5561 (in this example, 5565-5568).
According to one embodiment of present invention, described in the patented claim of submitting in present patent application and before by the inventor, data entry system of the present invention can forecast that (predictive) software combines with word.When pressing respective keys, the user can the application of the invention at least one beginning character of data entry system (for example saying a part) input word corresponding to the word of at least one character, and continue to press corresponding to the button of described word remainder and silent.(because accurate data input system of the present invention cause) accurately imported the beginning letter of described word and followed the button of pressing corresponding to the residue letter of described word (and silent), may make the accurate data input system also allow still less voice.Be appreciated that in the present embodiment, preferred, can give independent button or mutual separately with same key the allocation of symbols that is not letter.
According to one embodiment of present invention, the keypad/data input cell of the present invention with a fewer keys can be connected with the conventional earphone of the electronic equipment of for example mobile phone/integrated.Figure 55 j shows the conventional earphone 5570 that is used by the user.Earphone can comprise loudspeaker 5571, microphone 5572 and keypad/data input cell of the present invention 5573 (many parts keypad in this example).Be appreciated that keypad/data input cell of the present invention can be used with corresponding electronic device when independent head microphone is used to import user's corresponding voice, be used for button pressed and import.
The inswept process that combines with data entry system of the present invention
As mentioned above, data entry system of the present invention can use for example object of a fewer keys, one or more multi-mode (for example multidirectional) button, one or more responsive pad, user's any kind ofs such as finger.Similarly, as described above, for example the described object of described button can be the button (for example, touching level and multiple stress level), soft-key button of for example conventional mobile-telephone-type button, tactiosensible button, corresponding two or more stress levels thereon, any kinds such as virtual key that combine with optical identification.
As mentioned above, when data entry system according to the present invention input word a part of, for identification better, except (for example providing corresponding to the information of the initial character/phoneme of described part, button is pressed and speed) outside, the user can provide more multicharacter other information corresponding to the intermediate character of for example last character and/or described part.
According to one embodiment of present invention, shown in Figure 56, for example have that the touch sensitive surface of minority presumptive area/button of zone/button 5601-5604/pad 5600 can be set up, and work with data entry system of the present invention.According to data entry system of the present invention, symbols is distributed to each described zone/button.The purpose of this embodiment is a part (for example, the comprising character by character) data/text input system that strengthens word/word of the present invention.According to this embodiment, for single character data input is provided, the user can for example click/double-click and press corresponding zone/button, and its (as mentioned above, according to data entry system of the present invention) combines/not combination with voice.In order to import the part of word/word with at least two characters, when saying described word/word a part of, the user can be with for example his finger or at least one zone/button on the inswept described surface of pen, and it is alphabetical relevant with at least one of the part of described word/word.Preferably, inswept process can be from the zone corresponding to the initial character of the part of described word/word, and it is preferred, finish with zone corresponding to the last character of the part of described word/word, and final (for example, for easier identification) is passed through on the zone corresponding to one or more intermediate characters of the part of described word/word.When described user from described surface/when sensitivity pad is removed (for example lifting) described finger (or described object), can finish corresponding to the information input of the part of described word/word.Be appreciated that can be before corresponding inswept release the voice of end user, still, system can consider described whole corresponding inswept action.
According to a further embodiment of the invention, in order to import the part of word/word, when saying it, the user can be with the inswept zone/button of his finger (if be represented by same area/button more than a continuous character, correspondingly, inswept on a plurality of different directions on described same area/button), this zone/button is corresponding to all letters of the part of the described word/word that is transfused to.With reference to figure 56a, for example, for a part " for " of importing word/word, when saying it, the user can with for example he finger or the pen inswept zone/button 5612,5614 and 5611, its respectively corresponding to the letter " f ", " o " and " r " (illustrating) by multi-direction arrow 5615.Then, the user can (for example responsive pad) lift his finger from described surface, and reporting system is corresponding to the information end of input of the part of described word/word.
According to a further embodiment of the invention, for mutual faster, in order to import word, the user can be with the zone of some letters of the inswept part corresponding to the described word/word that is transfused to of his finger.With reference to figure 56b, for example, for a part " for " of importing word/word, when saying it, the user can be from (for example, corresponding to letter " f ") zone 5622 beginnings and the zones 5622,5621 (by arrow 5625 expressions) of finishing in (for example, corresponding to letter " r ") zone 5621 go up with his finger or pen inswept, and without zone 5624 corresponding to alphabetical " o ".
Inswept process on the sensitivity pad is better than the pressing of conventional non-sensitive button/release movement part and is, when using inswept process, only on zone/button of finishing corresponding to the letter of the part of a plurality of (or all) word/word inswept after, the user just can lift his finger from described sensing surface.The voice of described part even the user was through with before corresponding inswept release, system also considers whole corresponding inswept action (for example, from time that the user contacts the time of first zone/button on described surface first, lifts his finger up to the user from described surface).Contact/inswept and lift finger from described surface also can reporting system: the starting point of corresponding voice and end point (for example, preferred, described voice are greatly in described time bar).
Generally speaking, according to one embodiment of present invention, with (for example carry out inswept mutual track corresponding to the surface of zone/button with predetermined number, corresponding to word with at least two characters) can comprise following point (for example tracing point), wherein, the letter of each described part corresponding to described word/word, wherein zone/the button of predetermined number is corresponding to described mutual:
1) starting point is corresponding to the initial character of the part of word/word
2) inswept direction changes point (for example, not necessarily, the word that has only two characters not being existed), usually corresponding to the intermediate character (if existence) of the part of described word/word
3) corresponding to other characters (preferred, last character (preferred, pronounceable)) of a part of P271 of described word/word
Figure 57 shows an example, and the track 5705 corresponding to the inswept action of word " bring " on surface 5700 has four zones/button 5701-5704.The initial of the described word of starting point 5706 reporting systems is positioned on zone/button 5703.Other three points/angle 5707-5709 reporting systems corresponding to direction change and inswept release: described word comprises a plurality of letters of at least three by the expression of one of character of distributing to zone 5701,5704 and 5702.Preferably, in the order of letter described in the described word (for example, in this embodiment, " bring ") order corresponding to described tracing point.Be appreciated that the described angle that changes corresponding to direction may less be emphasized, and form for example curve form.Figure 57 a shows the example corresponding to the inswept track of word " time " (being illustrated by the arrow 5714 with crooked angle 5715).In this example, according to letter " t " (for example), " i " (for example) and " m " (for example), provide inswept action by button/zone 5713 expressions by button/zone 5712 expressions by button/zone 5711 expressions.Be appreciated that when inswept the user says described word (" time " for example in this example).
Of the present invention knocking/press and/or inswept data entry system will reduce letter and significantly with described letter beginning and have ambiguous between the word of similar pronunciation.Based on the principle of just having described, for example, for input alphabet " b ", and the part of word/word " be " and " bee ", can consider following process:
-for input alphabet " b ", shown in Figure 58 a, the user can click/contact (and not inswept) sensitizing range/button (for example, in this example, zone/button 5801) corresponding to letter " b " as before, sends the sound of described letter simultaneously.
-a part " be " in order to import word/word, as Figure 58 b and above-described shown in, when the sound of a part of sending described word/word, the user can be inswept on sensing surface 5810, from zone 5811, then pass through/end at zone 5812 corresponding to letter " e " corresponding to letter " b ".The corresponding inswept path/track of arrow 5813 expressions.
-a part " bee " in order to import word/word, as Figure 58 c and described above shown in, when the sound of a part of sending described word/word, the user can be inswept on sensitive plane 5820, it starts from the zone 5821 corresponding to letter " b ", through/inswept zone 5822 corresponding to (for example first) letter " e ", then on same area 5822, change inswept direction corresponding to (second) letter " e ".(for example make two tracing points, in this example, intermediate point and terminal point) can reporting system on same area/button: at least two letters of the part of described word/word are positioned at/distribute to described zone/button, and are located in the part of stating word/word after the letter corresponding to region in front/button.The corresponding inswept path of arrow 5823 expressions.
Must be noted that, go out as shown, the each change on inswept direction may be corresponding to word in other letters accordingly.When sweeping to another zone from a zone, the user may not wish the zone of process through him.System can not consider described path, for example, the inswept track on described the zone whether inessential inswept path 5824 of zone/button 5825 of Figure 58 c (for example, referring to), and/or in described zone, whether there is not an angle (for example, not having the change of direction) etc.Equally, in order to reduce and/or to eliminate indistinctly, that can consider zone 5826 for example passes through (for example) zone.
As mentioned above, can carry out combination to data system character by character of the present invention and a part of data entry system that pursues word/word of the present invention.Equally, can be to of the present invention inswept and press embodiment and carry out combination.For example, in order for example to write the word of " stop ", the user can import this word with two parts " s " and " top ".For input alphabet " s ", the user can (single) touches/presses the zone/button corresponding to letter " s ", and sends the sound of described letter simultaneously.Then, for importation " top ", when sending the sound of described part, according to the principle of described inswept process of the present invention, the user can be inswept on corresponding zone/button with for example his finger.
In order to reduce or eliminate the accidental vagueness that contacts with the zone/button of sensing surface, except tactiosensible feature, for example click/can be provided with separately zone/button than other features of weight power system (for example, being provided with the system of the button of conventional mobile phone keypad).In this case, for example, for (for example, according to data entry system character by character of the present invention) imports single symbol, rather than slight contact, user more important place presses corresponding zone/button, is used to import described symbol.In order to enter into a part of data entry system by word/word of the present invention, the user can use aforesaid inswept process by inswept with for example his finger slight on corresponding zone/button (for example, using light pressure).
If the part of word/word is included in the letter of representing on single zone/button, when saying described word/word a part of, at a plurality of continuous different directions (for example, at least one direction, and the direction number alphabetical number (n) that equals to constitute the part of described word/word (for example subtracts one at the most, n-1 direction)) on, the user can use for example his inswept described zone/button of finger.For example, in order to import word " you ", shown in Figure 59 a, except saying described word, the user can be once inswept on zone/button 5901 his finger, be used for reporting system described zone/button (according to one embodiment of present invention, importing single character is represented by knocking on described zone/button) distributed at least two letters of the part of described word/word.For by providing more information to import same word to system, shown in Figure 59 b, described user can be inswept corresponding at least three letters of the part of described word/word (for example with his finger, in this example, all letters of formation word " you ") two continuous different directions 5912 on zone/button 5911,5913 (for example, two straight/almost straight directions), and not from described zone/button (not for example, three tracing points are provided in this example, a beginning, a centre, end) removes (for example lifting) his finger on.
As mentioned above, in order to import the part of word/word, the user can say the part of described word/word, and on the subregion/button at least of the respective symbol (for example letter) of the part of expression word/word the inswept for example object of his finger.According to one embodiment of present invention, preferred, the user can inswept expression initial, a medial (for example, if exist) and the last alphabetical zone/button of the part of described at least word/word.Preferably, consider wanting inswept last letter can be last letter corresponding to the last pronounceable phoneme in the part of word/word.For example, word " write " will can be considered it is (for example, pronounceable) letter " t " rather than letter " e " (for example, in this example, letter " e " is mute) by inswept last letter.Be appreciated that if desired the user can be according to two letters " t " and " e " and be inswept.
According to another example, the user can be according at least one residue consonant of the part of the initial of the part of word/word and described word/word and inswept.For example, in order to import word " force ", the user can be according to letter " f ", " r " and " c " and inswept.
According to one embodiment of present invention, in order to import word with at least two parts, the user is (for example, by pointing with it) inswept zone/button according to first at first, says described part simultaneously.Then, he can lift (for example removing) his finger from sensing surface, and the input that is used for reporting system described (for example, in this example, first) part finishes.Then, the user enters into according to the same principle next part of input (like that).At the end of word, the user can for example provide and press/contact the action of space bar.
In order to import word with at least two parts, according to a further embodiment of the invention, the user is (for example, by pointing with it) inswept zone/button according to first at first, says it simultaneously.Then, he (not lifting/remove his finger from described sensing surface) enters into according to the same principle next part of input (like that).At the end of word, the user can lift (for example removing) his finger from sensing surface, and the input that is used for the described whole word of reporting system finishes.Then, the user can for example provide the action of pressing/contacting space bar.In this embodiment, as described, lifting finger from writing surface can be corresponding to the end of whole word input.Therefore, before described word/can provide space bar automatically afterwards.
Be appreciated that, preferably, inswept zone/button and, if desired, the order of the different directions in described zone/button can be corresponding to the sequence of positions (for example, from left to right, from right to left, from top to bottom wait) of corresponding letter in the part of corresponding word/word.For example, when with English input word/word a part of, the user can be inswept corresponding to/or according to the zone/button of the letter of position from left to right in the part of described word/word.In another example, when with for example Arabic or Hebrew input word/word a part of, the user can be inswept corresponding to/or according to the zone/button of the letter of position from right to left in the part of described word/word.As described with aforesaid, be appreciated that the user can according to/corresponding to the inswept zone of the part of described word/word (and direction), or according to/corresponding to some alphabetical inswept zones (and direction) of the part of described word/word.
As mentioned above, the some or all systems described in the patented claim of submitting in present patent application and before by the inventor, method, feature etc. can be carried out combination, are used to the embodiment/product that provides different.For example, after importing word (for example, the inswept data input of the application of the invention) by part, as mentioned above, and for the input of each part, can be by the relevant alphabetic string of system's selection more than one.In this case, as mentioned above, the various combination of described selection can be provided and compare with the word of word database.If described combination corresponding to the word more than a described dictionary, then can be shown to the user according to their frequency of utilization, from the word of the most frequent use to the least frequent word that uses.This problem was described in detail in front.
Can be applied to automatic space of the present invention process to use the data entry system of inswept method of the present invention.
As mentioned above, different automatic space processes can be considered, and combine with data entry system of the present invention.(as mentioned above) according to one embodiment of present invention, the part of each word/word can have special space characteristic, for example described below these:
-preferred, the part of word can be the sort of (for example " ing ", " ment ", " tion " etc.) that give tacit consent on the part that is connected to previous word/word
-preferred, the part of word can be connected on the part of previous word/word, and a part that also needs the part of next word/word to be connected in its sort of (for example " ma " in the word " information ")-word can be independently significant word, can be free of attachment on the part of former word/word.Acquiescence, before or after described word, provide space character automatically, unless for example user or phrase context need it to be connected on the part of described front/next word/word (for example " for ", " less ")
-can consider that (for example acquiescence) single character for example alphabetical, digital, punctuation mark is to be connected to automatically on the part of front/next word/word, unless make decision in addition
According to one embodiment of present invention, based on data entry system character by character of the present invention, for example the input of Zi Mu single character can be distributed to voice and combine/the pressing/knock of the respective regions/button of uncombined touch sensitive surface, and the input of the part of word/word can be assigned to a part of saying described word/word, on zone/button that the beginning character of described word is assigned to, provide simultaneously folk prescription to (for example, almost straight direction) inswept action.For example, for input alphabet " z ", when saying described letter, the user can press/touch the button that (not inswept) distributes to described letter " z ".For a part " zoo " of importing word/word, when saying described word/word a part of, zone/button that the user can be inswept distributes to described letter " z " the beginning letter of word " zoo " (for example, corresponding to).This can make system understand the user view of a part of input process of character input process or word/word easily.
As described and/or shown, data entry system of the present invention can provide many embodiment based on the principle of describing in the patented claim of being submitted to by the inventor.Based on described principle and different embodiment according to the subject invention, for example, can consider to have the different keypads of different number buttons and/or different button mapping (for example, the difference of symbol is arranged on keypad).Electronic equipment can comprise that more than a described embodiment it may need some described different keypads and/or different button mappings.In order in same electronic device, to allow to provide described keypad and/or button mapping, can provide physics and/or virtual keypad and/or button mapping.
According to one embodiment of present invention, according to current embodiment of the present invention, different keypad on the electronic equipment and/or button mapping can be arranged on the display unit of described electronic equipment automatically.The user can be for example as required or his preference, select an embodiment the different embodiment of a group of in described electronic equipment, existing.For this reason, (for example) can be provided with for example device of pattern in described electronic equipment, can use it by described user, is used to select one of described embodiment and corresponding corresponding keypad and/or button mapping.
According to another embodiment, for example, the button of the keypad of described equipment (for example, if described electronic equipment is a phone, the button of its keypad) can be used at least some buttons of described keypad, show different button mappings, rather than the display unit of use electronic equipment, be used to show the mapping of keypad and/or button.For this reason, the described button of described keypad can comprise the modifiable demonstration keycap of electronics (printing keycaps) (for example, keytop).
Again according to another embodiment and with reference to former embodiment, according to corresponding data input embodiment, different hard button mappings can be set up, and are delivered for use with described electronic equipment, and do not use the keypad with the modifiable demonstration keycap of electronics.Figure 60 shows tradable (for example, preceding) lid example of 6000 of mobile phone, and it has corresponding to many cavities of physics keycap (usually by mobile phone manufacturer with the elastomeric material manufacturing) (for example, for example hole 6001).Use described mobile phone and tradable lid, can be provided corresponding to different interchangeable hard (for example, physics) button mapping of related embodiment of the present invention (for example, for example button mapping 6011-6013).After the required embodiment that selects data entry system, the user can manually replace corresponding button mapping in described lid (with described phone).
The different predetermined pad that can provide corresponding to each described zone is provided, touches and/or press responsive key etc., rather than have the single pad of different presumptive areas.Equally, user's finger can be used to described symbols and described inswept mobile distributing to touch sensitive surface or any other (are for example pointed recognition system, optical scanning) the described finger that combines is as pointing recognition systems at described in the application and the application submitted in the past other.Must be noted that, for example, can use the mutual replacement inswept data entry device of the present invention of the technology of any kind and for example two kinds of stress levels, so that identical result to be provided.Equally, can use for example any kind of button and the object of number.These problems were described in present patent application with in the patented claim of submitting to before by the inventor.
According to one embodiment of present invention, (for example, in different applications, described) symbol and configuration thereof can be assigned to other objects of user's operation of the several fingers of a few users for example and described finger, rather than the mode of operation of a fewer keys and described button.Described user's described finger can replace the button of keypad, and, described finger described move for example can replace single and/or press for twice, different mode such as inswept process.The described operation of described finger and described finger can be used for the user behavior that sound for example and/or lip move.Different embodiments of the invention of providing as mentioned above and will describing later on can be provided for the different recognition systems that are used to discern described object (part of for example pointing, pointing, finger mark recognition system, scanning system, optical system etc.) and the different recognition systems that are used to discern described behavior (for example sound and/or lip recognition system).
Use four buttons to be used for the embodiment of the system of data input according to one embodiment of present invention and by reference, can use four fingers rather than four buttons of user that the symbol that is assigned to described button is distributed.Equally, for example, for example the device of optical recognition system and/or sensing surface can be used to discern described finger mutual/move.For example, for input alphabet " to ", the user can knock one of finger of being assigned to of (for example clicking) letter " t " from the teeth outwards, sends the sound of described letter simultaneously.Still based on data entry system of the present invention, for example other recognition devices of sound recognition system can be used to discern user's voice, and help system provides output accurately.
The use of multi-direction button or trace ball is used for a part of data input of word/word
Trace ball or (for example have minority for example, 4) other devices of predetermined multi-direction button by lower area/button can be provided with data entry system of the present invention, and do not use touch sensitive surface/pad with the minority presumptive area/button that combines with inswept process of the present invention, be used to import the part of word/word.The principle of this system can be similar to the described principle that is used for described inswept process and other data entry systems of the present invention.
According to one embodiment of present invention, trace ball with rotation can be used for data entry system of the present invention, this rotation can be towards described trace ball one group of predetermined point/zone on every side, and wherein, the symbols according to data entry system of the present invention can be assigned to each described predetermined point/zone.As described, the principle of described system can be similar to the described principle of inswept process that use is had the touch sensitive surface/pad of minority presumptive area/button.Difference between these two systems is that, trace ball replaces described touch sensitive surface/pad here, and described trace ball be substituted in towards the rotation in described predetermined point/zone on the described presumptive area/button of described touch sensitive surface/pad inswept/press action.As mentioned above, on touch sensitive surface/pad, use all descriptions of the data entry system of the present invention of inswept process can be applied to using the described data entry system of described trace ball with minority presumptive area/button.Figure 61 a shows the example of trace ball 6100, it can rotate towards four presumptive area 6101-6104, wherein, for each described zone, according to the different pieces of information input system of the present invention described in the application of submitting in the application and before by the inventor, for example the predetermined symbol groups such as a part of alphabetic characters, word, word can be assigned with, and be used for and with pressing/inswept principle that of the present invention speak/silent data entry system combines.For mutual better with described trace ball, described zone can show on display unit with the described symbol of distributing to them, and described trace ball can be operated pointer on described display unit and described zone.According to another kind of method, before each the use and afterwards, described trace ball can be arranged in the precalculated position.The center of described trace ball can indicate by a mark 6105.For incoming symbol, the user can at first be placed on his finger (for example thumb) on the described point, and begins to move on the direction according to the symbol that will be transfused to.
Continue with reference to current embodiment, shown in Figure 61 b, for example, for a part " ram " of importing word/word, the user can be towards zone 6111,6112 and the 6113 rotary motion trace balls 6110 corresponding to character " r ", " a " and " m ", and preferred, say the part " ram " of word/word simultaneously.
According to a further embodiment of the invention, data entry system of the present invention can use (for example 4) the predetermined multi-direction button of pressing lower area/button that has minority, and wherein, the symbols according to data entry system of the present invention is assigned to each described zone/button.Described multi-direction button can provide two category informations for data entry system of the present invention.Corresponding to the type I information of pressing action on the described button, and corresponding to second category information in the button/zone of described button, wherein, describedly press action and be employed.The user can press the single zone/button corresponding to the described button of described symbol (for example first character), and say/do not say described symbol, perhaps, he can press the zone/button corresponding to the described button of the initial character of described symbol, and with he the inswept described button of finger zones of different/button (for example, as described to inswept embodiment, when described symbol comprises more than a character, be used to provide more information) about the character that constitutes described symbol, continue simultaneously to keep described button to be in depressed position, and preferred, say described symbol simultaneously.When described symbol input process finished, the user can discharge the above action that continues to press of described button.As described, the principle of embodiments of the invention can be similar to the described principle of inswept process that use is had the touch sensitive surface/pad of minority presumptive area/button.The difference of these two systems is, here, multi-direction button replaces described touch sensitive surface/pad, described presumptive area/button that and the single on the described presumptive area/button of described multi-direction button/press continuously action replaces described sensing surface/pad inswept/press action.Aforesaid all descriptions of using the data entry system of the present invention of inswept process on the touch sensitive surface/pad with minority presumptive area/button can be applied to using the current data input system of the present invention of described multi-direction button.Figure 61 c shows the example of multi-direction button 6120, as described herein, wherein, described button comprises four presumptive areas/button 6121-6124, wherein, to each described zone/button, according to different pieces of information input system of the present invention (as described in the application of submitting in the application and before) by the inventor, for example the predetermined symbol groups such as a part of alphabetic characters, word, word can be assigned with, and are used for of the present invention pressing and the principle of the data entry system of speaking.
Calculating/communication facilities with multiuser interface
According to one embodiment of present invention, for example describe before in this application and can be included in keypad on the one side at the calculating communication facilities shown in the example of for example several figure of Figure 47 a-47i, be used for dialing the number at least.Described keypad can be a standard telephone type keypad.Figure 62 a shows the mobile communication equipment 6200 that comprises data/text input system of using a fewer keys (, arranging with two row 6201-6202) here, and relevant display unit 6203, as mentioned above.For dialing discontinuously, can consider to be positioned at the phone shape keypad of described equipment opposite side.Figure 62 b shows the rear side of described equipment 6200, and wherein, phone shape keypad 6211 becomes one with the described rear side of described equipment.The user can use keypad 6211 to be used for for example conventional dialing, or is used to provide for example other telephony features of choice menus.Also for example other telephony feature buttons of transmission/end key 6212-6213 can be set on described side.Also can display unit display unit 6214 arranged apart with described data/text input system be set, be used to show the phone operation of for example transfering to number or receiving number in this side.The pointing device 6215 that data/text input system of the present invention of implementing in described equipment (as mentioned above) relates to also can be integrated in this side.As described above in the patented claim of submitting in the application and before by the inventor, (click) button that relates to described pointing device can be positioned at the opposite side of the opposition side of the described electronic equipment that for example relates to described pointing device.
Be equipped with the calculating/communication facilities of hand-written data input system
According to one embodiment of present invention, except data entry system of the present invention, calculating of the present invention and/or communication facilities can comprise hand-written discrimination system, are used for dialing the number at least.Described hand writing system can be for example based on any kind of the hand writing system of the identification of the sound/vibration of the writing end (tip) of equipment on writing surface.This problem was described in detail in the PCT application of submitting to Dec 26 calendar year 2001 that is called " pen-based computer ".Data input based on hand-written discrimination system is slower.On the other hand, described data input is interrupted.Preferably, hand-written discrimination system can comprise of the present invention press and the equipment of the data entry system of speaking in be used for short and data incoming task that be interrupted.Describe before Figure 63 a for example shows and in many figure of for example 47a-47i as calculating shown in the example and/or communication facilities 6300.In this example, described equipment uses six press keys 6301-6306, wherein, as mentioned above, can distribute to four described button 6302-6305 (at 2 at every end) to the alphabet of language (same, as to be digital at last) character.Other two buttons 6301 and 6306 can comprise other symbols of at least some punctuation marks for example and/or function (for example, for Edit Text).
As mentioned above, using the data entry system of the present invention of a fewer keys is system very soon and accurately.In some cases, usually, when the short-term that need for example dial the number was made great efforts, the user may would rather use the data entry system of interruption.The hand-written data input system needs usually if it were not for very little touch sensitive surface (for example, display/pad).It also needs pen, is used for writing on described surface.Hand-written data input and recognition system by inventor's invention generally do not need described sensing surface and described pen.It can be implemented in any equipment, and in having undersized equipment can not be by other hand-written discrimination systems.
Continue with reference to figure 63a, can in described equipment 6300, implement by the hand-written discrimination system of inventor's invention.For this reason, the end at for example described equipment can be provided with writing end 6307.By described hand-written discrimination system need for example at least other features of microphone can in described equipment 6300, implement.For example be appreciated that based on optical sensor or use other hand-written discrimination systems of the system of accelerator can be used for described equipment.The user can separately use described data entry system according to his mode easily, and/or combines each other and use described data entry system.For example, described user can dial by only using the hand-written data input system.On the other hand, the data entry system text writing of pressing and speak that described user can the application of the invention.Also can be during the data input of for example text writing in conjunction with described system.For example, during text writing, the user can the application of the invention the described text of data entry system written portion and be transformed into hand-written data input system (for example,, use and write the described hand writing system of sound/vibration) pressed and speak for example by inventor's invention.The user can be by writing with nib from the teeth outwards, or speaks/silent and press corresponding button, is transformed into another from a data input system.
As mentioned above, be appreciated that based on of the present invention press with speak/different symbol that the different embodiment of silent data entry system can consider different key layout and distribute to described button disposes.Figure 63 b shows according to a further embodiment of the invention, is similar to the example of equipment 6310 of the equipment 6300 of Figure 63 a, difference is, here, data entry system of the present invention can use four buttons (at other button of one of every side in its every side 6311,6312, wherein, for example glossary of symbols of punctuation mark character and/or function is distributed to each described other button).Have other buttons and can help in data entry system of the present invention, to consider more symbols.By giving described other buttons some allocation of symbols of distributing to other buttons, can help to provide better input accuracy, cause the key assignments symbol still less that uses for native system.
According to a further embodiment of the invention, in order easily to distinguish a part of data entry system of data entry system character by character of the present invention and word/word of the present invention, alphabetic characters can be distributed to the key groups of another key groups that the part that is different from word/word is assigned to.This can improve the accuracy of data input significantly.Figure 63 C shows the example of the equipment 6320 of the equipment 6310 that is similar to Figure 63 b, and it has two cover four buttons (2*2) in every side.In this example, button 6321-6324 can be correspondingly corresponding to the alphabetic characters of printing off on described button, and button 6325-6328 can be correspondingly corresponding to the part of word/word, it starts from the character that prints off on described button.For example, in order for example to import the single letter of letter " t ", the user can push button 6321 and say described letter.Equally, for example, for a part " til " of importing word, the user can push button 6325 and say the part of described word.
Be appreciated that as described above and illustrate, described button can be arranged apart with described electronic equipment in it is arranged, for example, in one or more keypads, wherein, described keypad can wirelessly or be wired to described electronic equipment.Equally, described in the different paragraphs in any embodiment of the invention and will describe, described a fewer keys, their layouts on equipment, give the described distribution of described button allocation of symbols and all only be illustrated as example with mutual, the described equipment self of described button etc.Clearly, can consider other variations by those skilled in the art.
Must be noted that as shown at Figure 63 a-63c and Figure 47 b-47d, according to one embodiment of present invention, data entry system of the present invention can have the shape of pen.Equally, as mentioned above, the computing machine/communication facilities of pen shape and feature thereof are invented, and describe in the PCT application of submitting to Dec 26 calendar year 2001 that is called " pen-based computer ".The equipment of pen shape of the present invention can comprise the some or all features and the application of described " pen-based computer " PCT patented claim.For example, the equipment of pen shape of the present invention can be tubular equipment, has its surperficial display unit of covering.Equally, for example, the equipment of pen shape of the present invention can comprise indication and pointing device, and the hand-written discrimination system that is similar to the hand-written discrimination system of described " pen-based computer " PCT.
According to one embodiment of present invention, the equipment of pen shape of the present invention can comprise and is used for by for example described equipment being tied user's clothes or ear it being tied user's the equipment of tiing.Figure 63 d shows for example example of the rear side of the electronic equipment of the equipment 6300 of Figure 63 a.As shown in the figure, can in described equipment, be provided with and tie equipment 6331, be used for described equipment is for example tied user's pocket or user's ear.Equally, loudspeaker 6332 is set in the equipment, is used to provide described loudspeaker near the ear chamber of described user's ear described tiing.The indicating member 6333 that is for example proposed by the inventor can also be set in described equipment.
Continue with reference to current embodiment, shown in Figure 63 e, as example, described equipment 6340 also can be tied user's ear, is used for allowing allowing the talk without hand when for example described user walks or drives.Pen shape described equipment 6340 and described microphone 6341 and described loudspeaker 6342 and tie device 6343 and can allow described microphone and described loudspeaker respectively near user's mouth and ear in the position in described equipment respectively.Be appreciated that described microphone, loudspeaker or tie any position that device can be positioned at described equipment.
Independent data input block of the present invention with a fewer keys comprises display unit
According to one embodiment of present invention, describe and illustrate, have at least that the independent data input block of the present invention of a fewer keys can comprise display unit, and can be connected on the corresponding electronic device as Figure 55 a-55j.Figure 64 a shows the example based on the independent data input block 6400 of previously described principle, and it comprises display unit 6401.(when particularly described unit is carried as hanger) has display in described unit advantage is, for example, the user can insert for example his pocket to described electronic equipment (for example mobile phone), and use described data input cell by described equipment, be used for input/reception data.By being connected to described equipment, by seeing the display unit of described data input cell, the user can see that he imports the data of (for example sending SMS) or reception (for example receiving SMS).Be appreciated that described display unit can be an any kind according to different system, and be disposed in the described unit according to different system.For example, shown in Figure 64 b, the display unit 6411 of the present invention 6410 independent data input block can be disposed in lid 6412 inboards of described data input cell.Be appreciated that independent data input block of the present invention can be included in the some or all features (for example, for example embedded microphone) in the previously described respective embodiments.
As mentioned above, use the data entry system of the present invention of a fewer keys in any equipment of for example PDA or dull and stereotyped PC, to implement, Figure 65 a shows the example of the electronic equipment of for example dull and stereotyped PC equipment 6500, and it comprises the data entry system of the present invention that uses a fewer keys.Key layout and allocation of symbols in described equipment, have been provided with based on data entry system principle of the present invention.In this example, described dull and stereotyped PC6500 can comprise four button 6501-6504, and the alphabet of language and last numerical character can be assigned to this four buttons at least.Except described four buttons, described equipment also comprises for example other buttons of button 6505-6506, for example, can for example at least the allocation of symbols of punctuation mark and function give these buttons.Being appreciated that on the display unit of described dull and stereotyped PC can defining virtual (for example, soft) button, and is used for data entry system, rather than physical button (for example 6501-6506).Data entry system of the present invention, key layout and be described in detail for the distribution of described button allocation of symbols.The part button or be arranged in the described equipment other buttons can with for example in the back side of described equipment integrated indicating equipment combine.This problem was described in detail in the different patented claims of being submitted to by the inventor.Described dull and stereotyped PC can comprise other buttons 6507, is used for for example other purposes such as opening/closing function.Figure 65 b shows the example of the dull and stereotyped PC6500 rear side of Figure 65 a.As shown in the figure, for stable better, during for example data were imported, described dull and stereotyped PC can also comprise one or more handle equipment 6511-6512 that used by the user when for example importing data.Be appreciated that described handle equipment can be any kind, and can be arranged in any position (for example not homonymy) of described equipment.As mentioned above, described equipment can comprise indicates and the click system at least, and wherein, at least one indicating member 6513 of described system can be positioned at the rear side of described equipment.As mentioned above, the front side (in position easily) of described dull and stereotyped PC be can be positioned at, described indication and pointing device (as required, with the left hand or the right hand) are used to allow easily operate corresponding to the button of described indication.According to a kind of design, described dull and stereotyped PC can comprise two described indications and pointing device, and it lays respectively at left side and the right side of described dull and stereotyped PC, and the collaborative work each other of the parts of described indication and pointing device.The microphone that is appreciated that any kind of built-in microphone for example or independent wire/wireless microphone can be used to receive user's voice during the data input.These problems were described in detail.Described electronic equipment also uses independent data input block of the present invention.
Equally, use the data entry system of the present invention of a fewer keys can be for example automatically, use in many environment of simulation or game environment.According to one embodiment of present invention, the button of described system can be arranged in for example vehicles of automobile.Figure 65 C shows the bearing circle 6520 of the up tool that comprises a fewer keys (in this example, being arranged on the opposite side 6521-6522) on described bearing circle 6520, and described a fewer keys is used to data entry system of the present invention.Data entry system of the present invention, key layout and described in detail for the distribution of described button allocation of symbols.As depicted therein, the user can import for example data of text during driving.For this reason, when the handgrip that uses the user was held described bearing circle 6520, for example, during driving, the driver can be by pressing described button and correspondingly speak/the silent use data entry system of pressing and speak of the present invention.Be appreciated that for example built-in microphone and/or for example the microphone of any kind of the wire/wireless microphone of Bluetooth microphone can be used to during data inputs, receive user's voice.Also can consider any key layout on any position in any kind vehicles of for example aircraft and be the allocation of symbols of described button.
As mentioned above, data entry system of the present invention and the data entry system of the present invention that generally speaking particularly uses a fewer keys are (for example, wherein, alphabet and last numerical character are distributed to four buttons arranging with two pairs of adjacent key, and wherein, the user can each of his two thumbs be put in button described each to last, be used to press one of described button) huge advantage be, the user can provide rapid and precise data input, and does not need (continually) to see button and display unit.
Be appreciated that seeing that corresponding display is used for input validation be the impossible/environment that is not allowed to (for example dark) and situation (for example driving), reporting system can be used to one or more last character/phrase of notifying the user to be transfused to.Described system can be text-voice tts system, and wherein, when identifying character by data entry system of the present invention, described character is said by system.May need the user the described symbol that identifies not to be confirmed by for example not providing any action.Equally for example, if the symbol that identifies is wrong symbol, the user can provide the predetermined action of for example using the deletion button, is used to delete described symbol.Then, he can repeat the input of described symbol.
Network implementation
Described in the patented claim of submission before relevant with data entry system of the present invention, data entry system of the present invention can be implemented in the network environment of for example LAN system, and this LAN system comprises the client terminal that is connected to server/principal computer.According to one embodiment of present invention, in described network environment, described terminal can be the mini-plant with processing power usually, or has the equipment of limited processing power at the most.On the contrary, server computer can have powerful processing power.In this case, server computer can be handled the information that sends it by the terminal of described network system to.By using terminal, the user can be according to the principle of data entry system of the present invention, the information (for example button, voice) of input about symbol being input to described server.After handling described information and identifying corresponding symbol, server computer can be sent to the result display unit of described terminal.Be appreciated that, described terminal can comprise and be used for the input of described information and be sent to all features (for example, for example key layout, distribute to the symbol of described button, microphone, camera etc. at least) of the required data entry system of the present invention of described server computer.Figure 66 shows the terminal/data input cell 6601-6606 that is connected to central server/computing machine 6600 as an example, wherein, shows the partial results by the different pieces of information/text of different pieces of information input block/terminal input on corresponding display.
Can in many environment of for example airline's aircraft, use the foregoing description.In the aircarrier aircraft of coming in, each passenger position comprises the remote control unit with finite population button, and described button is connected to the display unit that is installed in front, described position (for example, being usually located at the rear side at seat, front) usually.Described remote control can combine with built-in or independent microphone, and can be connected to the server/principal computer in the described aircraft.Other individual calculates or data input device can be used by their (for example, by being installed in the USB port in the described seat) are connected to described server/principal computer, rather than described remote control.As mentioned above, described equipment can for example be data input cell of the present invention, PDA, mobile phone or even notebook etc.This may become term of voyage offers its passenger by airline the most attractive entertainment service.The passenger can edit mail, transmission information, use the Internet or with described aircraft in other passengers' chats.Similar system can tissue or commercial (for example, the point of sale of chain stores) implements in the networked system, wherein, comprise that essential feature (for example button, microphone) is used for can being used together with server computer based on the data input cell of data entry system input data/text of the present invention.The data of the invention described above/text input system permission is by the general rapid and precise data entry system that does not have processing power or have the terminal device of limited processing power.
Using the data entry system of the present invention (for example, comprise four buttons, wherein, alphabetic characters is assigned to described button at least) of a fewer keys may be useful in many environment.As mentioned above, based on the principle of data entry system of the present invention, the user can use for example his the moving of face/head/eye that combines with its acoustic phase, and does not use button, is used for data/text input.According to one embodiment of present invention, for this reason, in the application and the symbol described in applying in the past (for example at least, be all alphabetic characters of language haply) can be assigned to for example user's head moving on for example four direction (for example left, right, front and rear), and do not distribute to a fewer keys.The symbol configuration distributes can be with described identical to button.For example, if letter " Q ", " W ", " E ", " R ", " T " and " Y " are assigned to left mobile of user's head, be used for input alphabet " t ", the user can be moved to the left head and say " T ".Same principle can be distributed to move (for example left and right, upper and lower) of eyes of user.By the last described example of reference, for input alphabet " T ", the user can be moved to the left eyes and say " T ".By being arranged on for example camera on the user's body or the device of sensor, the mobile detection of enemy, eye, face etc.
Not using the foregoing description of button, may be useful to carry out the data input by the people with finite motion ability.For example, the blind person can use his/her head to move in conjunction with its sound, and the people that can not use its finger to be used to push button can use his eye/head to move in conjunction with its sound.
According to a further embodiment of the invention, as mentioned above, described allocation of symbols is given user's the moving of finger, rather than give a fewer keys allocation of symbols.For example, Figure 67 shows user's hand 6700, wherein, based on the symbol configuration of distributing to a fewer keys of the present invention, can distribute to the symbol configuration four finger 6701-6704 (for example, two of every hand fingers) of described user's hand.For example, can distribute to letter " Q ", " W ", " E ", " R ", " T " and " Y " part of the word/word of described letter beginning (perhaps, with) predetermined mobile or point 6701 gesture.As example, described moving can be to move down described finger.Equally, for example, for input alphabet " T ", the user can move down finger 6701, and preferred, says " T " simultaneously.Be appreciated that based on the principle of the data entry system of the present invention described in the application and the application submitted in the past, can consider any configuration of symbol, and it is distributed to the user's of any number finger.
Continue to describe the foregoing description, can consider many systems, be used to detect described user's the moving/gesture of finger.For example, can detect user's the moving of finger with respect to the position of another finger by described finger.According to a kind of method, shown in Figure 67, the finger 6701-6702 that is used for the data input can be provided with sensor 6705-6706 (form to encircle) for example here.According to an embodiment, friction based on described adjacent ring 6705-6706, based on the vibration that for example receives by described sensor, can discern user's (for example the moving of finger, the surface that is appreciated that described ring can be to make that the frictional vibration that moves up with move down of described finger can be different).
According to another kind of method, sensor 6707,6708 can be installed on the ring device (or being installed on other devices of finger of user), and wherein, and what the mutual position of described sensor can be determined to point moves.
Be appreciated that finger described herein move/hand gesture detecting device just is described as example.Can consider for example other pick-up units of optical detection device.
Token-category
According to one embodiment of present invention, can in the specific environment of for example medical treatment or judicial environment, use the part level data input system of word/word of the present invention.In this case, described system does not use the big database of the part of word/word, and can consider to relate to the finite data storehouse of a part of the word/word of described environment.This will improve the accuracy and the speed of native system significantly.Can import the part of the word/word outside the described database character by character.
The mode key that is used for the interim input of data character by character
According to one embodiment of present invention, in the data entry system of the present invention of a part of data input that combines data/text input character by character and word/word, can use the predetermined key reporting system, the user imports single character temporarily.For example, during text input, the user can be according to the principle of a part of data entry system of word/word of the present invention, the importation text, and do not press described predetermined key.In this case, system can not consider to distribute to the letter that described user pushes button.System can only consider to distribute to the part of the word/word of described button.If described predetermined key is for example pressed simultaneously with other buttons that relate to described text input and is pressed, then system can only consider distribute to the single letter that described button is pressed, and ignores a part of data input of distributing to word/word that described button presses.
The phrase input
According to a further embodiment of the invention, as mentioned above, data entry system of the present invention can comprise phrase level text input system.For example, after the whole phrase of input, by for example using data entry system of the present invention in conjunction with a part of data entry system of data character by character of the present invention/text input and/or word/word, system can analyzing the described phrase that identifies, and based on the characteristic of speech sounds/pattern of described language and/or the meaning of described phrase, the part word of described phrase can be proofreaied and correct, adds or be replaced in system, is used to the phrase that provides error-free.For example, if the user imports phrase " let ' s meet at noon ", and the word that identifies is " letsmeet at noon ", by analyzing described phrase, system can use word " let ' s " to replace word " lets ", and phrase " let ' s meet at noon " is provided.The advantage of present embodiment is, because data entry system of the present invention is the system of pin-point accuracy, so the user needn't worry to proofread and correct the minority mistake that occurs in during phrase is imported.System can be from the described mistake of normal moveout correction.Be appreciated that some symbols of for example ". " that provide at the end of phrase or return command can reporting system about the end point of described phrase.
The phrase input
According to one embodiment of present invention, for example distribute to the symbol of the object of button and can represent phrase.For example, group of words (for example, " Best regards ") can be assigned to button (for example, preferably, also representing the button of letter " b ").The user can press described button and the voice of for example saying described phrase or the described phrase of part (for example, in this example, saying " best regards ") are provided, and is used to import described phrase.
For single character with for the different mode of the part of word/word
As mentioned above, data entry system of the present invention can use different mode (for example, with the distinct interaction of the object of for example button), wherein, can give each described pattern the predetermined symbol set of dispense of distributing to object.Similarly, as described above, for example, described pattern can be that weak point/single is pressed action, pressed action, on button twice in the length on the button and press action, use weak point/length/two posture of finger/eyes etc. etc. on the button.
According to one embodiment of present invention, part, phrase that comprises single character more than character or phrase, word, word etc. can be assigned to different mode.For example, for example Zi Mu the single character single/weak point that can be assigned on the button is pressed action, and a part that comprises the word/word of at least two characters (for example can be assigned to button, same key or other buttons) on press action for twice or longly press action, or vice versa (for example, equally for example, comprise that the single that the part of the word/word of at least two characters can be assigned on the different buttons presses action).Equally, for example, as mentioned above, cause and press action twice that the part of a part of the word/word of voice (for example, sound, lip) recognition system ambiguity can be assigned on the button.Equally, different single characters, word etc. can be assigned to light, heavy on the button or press action twice.Equally for example, not with distribute to the part that single letter with the mutual pattern of button produces indistinct word/word and can be assigned to the described pattern mutual with described button.Different interactive modes was described in the application with in other patented claims of submitting to before by the inventor.
Be appreciated that and consider to press action/pattern with different predetermined amount of time/stress level definition.For example, short time (for example on button, 0.20 second at the most) press action and can be considered to that (first symbols can be assigned to) is short presses action, (for example press action for a long time, greater than 0.20 to 0.40 second) can be considered to that (second symbols can be assigned to) is long presses action, and longlyer press action (for example, greater than 0.40 second) and can be considered to another pattern, can distribute to this pattern to (for example, aforesaid) repetitive process.For example, for input alphabet " a ", the user can lack and push button (wherein, described button and described mutual with described button being distributed in letter " a "), and says " a ".He can longlyer press described button and say " a ", is used for for example obtaining the part " ai " (for example, wherein, the part of word/word " ai " being distributed to described button and described mutual with described button) of word/word.The user can press described button and say " a ", and (for example, longer time section) remains on depressed position described button to go up, be used for repetition input alphabet " a " on demand.Letter " a " will be repeated, and discharge (stopping the described action of pressing) described button up to the user.
As mentioned above, the word that comprises (for example, described word front/back) space character can be assigned to the interactive mode of the present invention with the object of for example button.According to one embodiment of present invention, described and interactive mode button can be the described button just described described longer/heavily press action.
As mentioned above, can consider any combination of object, interactive mode, character set etc., and be used for data entry system of the present invention.
Backspace
The backspace process of the part of word/word that deletion has been imported was described in the application front.Send out embodiment according to difference, at least a backspace process can be assigned at least a interactive mode, for example, the backspace button can be provided, wherein, by pressing described button, the part of at least one required language, word/word, phrase etc. can be deleted.For example, on described button each single press action can delete corresponding to be positioned at after the described output, the output of single language before the cursor.For example, if the user has imported a part " call " and " ing " of word/word, according to a process, he for example can press described button once by single, deletion ultimatum language " ing ".Another time single on described button is pressed action can delete output " call " corresponding to another language.According to prior defined procedure, for example, the single on described button/twice is pressed action and can be deleted whole word " calling ".Therefore, according to the principle of backspace process of the present invention, clearly, those skilled in the art can consider many predetermined delete procedures.
Kinds of miniaturized keyboards
Kinds of miniaturized keyboards is used to small-sized/mobile electronic device.Use the main inconvenient part of described keyboard to be,, use user's finger to push button to cause mistake to press described button because button is very little and adjacent to each other.Here it is why in PDA, usually with pressing described button.Data entry system of the present invention can be eliminated described shortcoming.Data entry system of the present invention can use PC type miniaturization/dummy keyboard.By button as target, be used to press it, even user error is pressed described button (by for example, press adjacent key), according to one embodiment of present invention, and based on the principle of data entry system of the present invention, the user also can say the voice corresponding to described button.If user's voice is corresponding to the button that is pressed, then system can think that described button pressed by mistake.Then, system can consider adjacent key, and described voice corresponding to one of described button.By using this embodiment, common user's finger can easily use kinds of miniaturized keyboards, makes the easy and quickening of data input by these keyboards.Be appreciated that the whole features and the system that can consider, and be used to this keyboard based on data entry system principle of the present invention.For example, a part of data entry system of word/word of the present invention also can be used for this embodiment.
Equally, as described and be illustrated by different embodiment, the principle of data entry system of the present invention is by the allocation of symbols of lesser number being given predetermined mutual with predetermine one, and from the symbol of described lesser number, symbol is selected by use/not using corresponding to the voice of described symbol, (for example, candidate) symbol to predetermined lesser number from the symbol of greater number is selected.
Similarly, as described above, described object and with the described of described object can be any kind alternately.As mentioned above, for example, described object can be the position (for example finger, eyes etc.) of user's body, and described predetermined can be to move described object alternately to for example different predetermined directions such as left and right, upper and lower.
According to one embodiment of present invention, described object can be an electronic equipment, and with described object described can be at the predetermined direction described electronic installation that tilts alternately.For example, each the described different less symbols that comprises the symbol of the big symbols of part can be assigned to the pre-determined tilt/direction of action that is applied to described electronic equipment, and big symbols is (as mentioned above) such as parts, function of letter, punctuation mark, the word/word of language for example.Then, still based on the principle (as mentioned above) of data entry system of the present invention, by providing/do not provide one of described symbol corresponding to the described less symbols of voice selecting of described symbol.Figure 68 shows for example example of the electronic equipment of mobile phone 6800.As example, four symbols 6801-6804 can be assigned to four vergence directions (for example left, up, right, down) 6805-6808 that is applied to described equipment.Still for example, for input alphabet " t ", can be tilted to the right equipment and send sound (for example, saying described letter) of user corresponding to the voice of described letter.One of advantage of pitch system of the present invention is that system can not use any button, and can use a hand to be used for the data input.It also allows to provide big display in equipment.Figure 68 a shows the electronic equipment 6810 of the data entry system that uses inclination of the present invention, and wherein, the big display 6811 basic surfaces that cover at least one side of described electronic equipment.For example be appreciated that single on button/twice presses single/inclined twice direction/action that the pattern of action can be applied to equipment here and replace.
The processing of apostrophe
According to one embodiment of present invention, can produce the predetermined word that comprises apostrophe, and it is distributed to one or more buttons and be transfused to.For example, for example word such as " it ' s ", " we ' re ", " he ' ll ", " they ' ve ", " isn ' t " can be assigned at least one predetermined key.By pressing corresponding button and saying described word and can import each described word.
According to another embodiment of the invention,, can produce for example " ' s for identical purpose ", " ' ll ", " ' ve ", (for example, the abbreviation) word of " n ' t " etc., and it is distributed to one or more buttons.Send the sound of described word by their original transcription.For example:
" ' s " can be pronounced " s/is/has ";
" ' re " can be pronounced " are ";
" ' ve " can be pronounced " have ";
" n ' t " can be pronounced " not " etc.
Described word can be imported into and for example be connected to the end that the front has been imported word/character.For example, in order to import word " they ' ve ", the user can import two independent words " they " and " ' ve " (for example, data entry system according to the present invention is imported) and not between the space is set.As mentioned above, distributing to the voice of the word that comprises apostrophe (for example, for example the abbreviation word of " n ' t " of word " not ") can be the same with original word.For example, word " n ' t " and " not " can send the sound of " not ".In this case, each described word can be assigned to the distinct interaction pattern with same key, or they each can be assigned to different buttons.For example, the user can single presses corresponding button (for example, the described button that is assigned to word " not " predetermined mutual) and says " not ", is used to import word " not ".In order to import word " n ' t ", the user can for example press same key (for example, the described button that is assigned to word " n ' t " is predetermined mutual) for twice and say " not ".According to another embodiment of the invention, comprise the part of the word of apostrophe/all can be assigned to the button that the apostrophe punctuation mark self is assigned to.
According to one embodiment of present invention, comprise for example " ' s of apostrophe ", " ' d " etc. the part of word can be assigned to button and with the mutual pattern of described button, and send for example sound of corresponding letters such as " s ", " d ".Described button or described interactive mode can be different from button or the interactive mode of distributing to described corresponding letters, are used to avoid indistinct.
Letter configuration on four buttons
As mentioned above, in order to improve the accuracy of speech recognition system, the symbol that has near pronunciation (for example, the voice system of one of them causes ambiguity to being used to select them) can be assigned to different buttons.Figure 69 shows another example of alphabetic characters being distributed to four button 6901-6904 of keypad 6900.Though they can be assigned to any button, preferred, comprise that a part more than the word/word of a character can be assigned to the button of initial character of the part of described word of expression and/or described word.The character of this example is arranged and has not only been eliminated the vagueness of using the text input system character by character of the present invention of four buttons that comprise letter, and it has significantly reduced the vagueness of a part of data entry system of word/word of the present invention.For example, letter " n " and can be assigned to button 6903, and letter " i " and can be assigned to button 6901 with the part of the word/word of " i " beginning with the part of word/word of " n " beginning.This is because for example, that (distributing to button 6901) word " in " and (distributing to button 6903) letter " n " can have is indistinct, roughly similarly pronounce.Clearly, as mentioned above, can consider based on the principle of just having described other symbol configurations on button by those skilled in the art, or the button of any other number and layout.
Equally, as mentioned above, according to another example, if the voice of two symbols have roughly similarly pronunciation, and described symbol be assigned to same key and by with the button same type (for example, combine with corresponding voice) import alternately, for fear of ambiguity, another voice that have roughly a not similar pronunciation with second symbol can be assigned at least the first symbol of a plurality of symbols.For example, if for example two symbols of " I " and " hi " (letter and the word that for example have roughly similar pronunciation respectively) are assigned to button, and say them simultaneously and import by for example pressing action with the single of button, for fear of ambiguity, for example, another voice of for example " hey " (it is roughly different pronunciations with " i ") can be assigned to symbol (for example, word) " hi ".
Input fast
As the front with here shown in Figure 69 a, at least one of advantage of alphabetic characters being distributed to four buttons only is, the user can (for example be placed on two buttons to each of his 2 fingers (for example a left side and right thumb) 6915,6916, two button 6911-6912, in this example, two button 6913-6914) on the respective column, make described finger can contact described two buttons simultaneously.This allows not remove (or seldom removing) finger from button during the text input, and therefore the user knows and presses which button and do not seeing keypad.Even described user is when motion, this also allows quick input.Be appreciated that for this reason, the distance between button size, the button and for example other parameters of the physical characteristics of described button can be to make said process optimised.
As implied above, be appreciated that the key configurations that can consider other as required.For example, described four buttons can be configured with the following methods, that is, when the user used a hand to import described text, preferred, his finger can contact described four buttons simultaneously.Equally, can be according to different needs, consider the button of different predetermined numbers that described alphabetic characters is at least distributed to.
As mentioned above and shown in the figure of for example Figure 52, multi-direction button can be used to data entry system of the present invention.Equally, as described, can consider the button of different numbers, the dissimilar/configuration of button, to be used for data entry system of the present invention.Equally, as described, the alphabet letters of language or text character can be assigned to four buttons that for example used by data entry system of the present invention.Figure 69 b shows the example of the electronic equipment 6920 of the button 6927-6928 with two multi-direction (for example, in this example, four direction), and wherein, the alphabetic characters of language is assigned to their four sub-button 6921-6924.The layout and the use that are used for four buttons of data (for example, text) input on the both sides of electronic equipment were described in front, and were illustrated by for example exemplary diagram of Figure 63 b.
Equipment with extendible flexible display unit
As mentioned above, according to one embodiment of present invention, comprise that the flexible display of OLED display for example and the equipment of data entry system of the present invention and its feature can be provided.Figure 70 a shows the example of flexible display unit 7000.By for example rolling display unit, be recoverable to described display unit in a side 7001 of display unit at least.Can launch it by opening described display.Figure 70 b shows the electronic equipment of the computing machine/communication unit 7010 that for example comprises flexible display unit 7011.Described electronic equipment also can comprise data entry system of the present invention and key layout of the present invention.In this example, described equipment comprises two part 7018-7019, arranges described button 7012-7013 on it.On at least one described part 7018,7019 of described equipment 7010, implement the assembly of described equipment.Described two parts can be connected to each other by wired or wireless.The part of described equally, at least display unit can be arranged (for example rolling) among at least one of described two part 7018-7019 of described equipment.(for example, ultimate range can be the maximum length of described display unit function) be launched and be regained to described two parts of described equipment can relative to each other at preset distance or by the required any distance of user.In this example, described two parts are in appropriateness distance relative to each other.By launching described two parts relative to each other, also can launch (for example, by opening) described display unit.The user can remain on each described two part 7018-7019 in its every the hand, and use the button 7012-7013 of each described part with corresponding hand, be used for data being imported described equipment 7010 and described display unit 7011 by for example data entry system of the present invention.Figure 70 c shows the described equipment 7010 and the described display unit 7011 of deployed condition more.For example the device of at least one button can be used to discharge relative to each other and/or fix and/or regain described part.Device by for example button and/or spring provides these functions automatically.The known described function of those skilled in the art.Figure 70 d shows the described equipment 7010 that is in closed condition.As described, described equipment can be communication facilities.In this example, can use described equipment as telephone unit.For this reason, microphone 7031 and loudspeaker 7032 can be disposed in the described equipment, and (preferred, at its two ends) makes distance between described microphone and the described loudspeaker corresponding to user's mouth and ear.Because described display is a flexible display, it may be frangible.Shown in Figure 70 e; described display for the described equipment of protection under deployed condition; described equipment 7010 can comprise the manifold for example assembly 7041 of rigidity roughly; it is when launching and regain described two parts of described equipment; also launch relative to each other and regain, make that described part provides flat surface when being in deployed condition; wherein, described display (not shown) can be placed on the described surface.Be appreciated that described assembly can be an any kind, and comprise any form and any withdrawal/development system.Equally, the distinct methods by for example folded or slip/non-sliding method is recoverable to/launches described display unit.
According to one embodiment of present invention, shown in Figure 70 f, the electronic equipment of for example just having described 7010 can comprise the printing/scanning/copy cell (not shown) that becomes one with it.Though this equipment can have any width, preferred, described design of electronic devices (for example, in this example, having the roughly height of A4 paper) can be to make to be used to print for example document file page of editor's mail by user's A4 paper 7015 of can packing into.
Providing total solution to mobile computing/communication facilities is exceedingly useful in many cases.For example, the user can draft the document of for example believing and print them immediately.Equally for example, the shop-assistant can edit the document of invoice for example and print it under client's agreement, be used for paying immediately.
According to another embodiment, can consider to comprise the foldable device of extensible display unit and data entry system of the present invention.Described display can be the flexible display of OLED display for example.Figure 70 g shows the described equipment 7050 that is in closed condition.Figure 70 h shows the described equipment 7050 of the button 7053-7054 that comprises described deployable display unit 7051 and described data entry system.Described equipment can have communication capacity.In this example, microphone 7055 and loudspeaker 7056 are set in described equipment, preferred, each is on the different piece of described equipment.
Be appreciated that this embodiment and relevant indicators are described and illustrate as example.Those skilled in the art can consider many in accordance with the principles of the present invention other embodiment and Tu.For example, by with reference to figure 70b, when described display unit is deployed into Len req, have only the described deploying portion of described display unit to be used by described equipment.For example, for example the system of the operating system of described equipment can manage and instruct described opening (for example, the launching) part that outputs to described display unit.Equally, described equipment can be included in the application at least and other patented claims of submitting to by the inventor described in to the small part system features.
Attachable/dismountable data input cell
As mentioned above, for example the electronic equipment of dull and stereotyped PC can comprise data input feature vector of the present invention, for example be arranged in described equipment front side key configurations of the present invention, be arranged in the pointing device of its rear side, wherein, described pointing device uses at least one button in the front side of described equipment, and vice versa.Similarly, as described above, described equipment can comprise the extendible microphone/camera that stretches to user's mouth from described equipment.As described above and illustrate, described feature can be configured for the external data input block of described equipment.Figure 71 a shows and is used for for example example of the detachable data input cell 7100 of the electronic equipment of dull and stereotyped PC.Described unit can comprise two part 7101-7102, and wherein, each described part comprises the button 7103-7104 of key layout of the present invention, is used for providing signal to described equipment.In this example, described part 7101 and 7102 is designed to be connected to two sides of described electronic equipment.At least one of described part (for example can comprise pointing device, mouse, not shown), wherein, when described detachable data input cell is connected to described electronic equipment, described pointing device can be positioned at the rear side of described equipment, and at least one button that relates to described pointing device (for example, the button of described key configurations) will be positioned at the front side of described equipment, make the user use identical at least hand to use described pointing device simultaneously and be arranged in described at least one related key and/or key configurations on the described part.Described data input cell also comprises and is arranged in extendible microphone 7105 and/or the camera 7106 that is used to receive user's voice in the extensible assembly 7107.The feature of data input cell of the present invention is described in detail in front.(for example, elastic webbing) device is connected to each other two part 7101-7102 of described data input cell, thereby described unit is fixed on the described electronic equipment by belt for example.Described data input cell is connected on the described equipment by lead 7108.It can be by for example connecting described electronic equipment the USB parts 7109 of USB port connect.Described data input cell also may be wirelessly connected on the described equipment.Equally, part 7101,7102 can be independent part, make the user can be for example with hand-held each (for example, his hand can in his pocket) that they are arranged, rather than they are connected to electronic equipment, be used for the data input.
Can consider to be used for described data input cell is connected to other coupling arrangements of described electronic equipment.For example, shown in Figure 71 b, described equipment 7100 can comprise assembly 7111-7112 slip and/or connection/separation, is used for described purpose.
Be appreciated that described data input cell can comprise the part of any number.For example, described data input cell can include only a part, and wherein, the feature of for example just having described (for example, the button of keypad, pointing device etc.) can become one with described part.
Figure 71 c shows and ties/be connected to for example described data input cell 7100 of the electronic equipment of computing machine (for example dull and stereotyped PC).As shown in the figure, the button of described data input cell 7103-7104 is positioned at the two ends of described equipment.Microphone stretches to user's mouth, and indicating equipment 7105 (not shown, here, in the back or on the side of described equipment) is disposed in the rear side (for example, clearly, at the rear side of described equipment) of described data input cell.Be positioned at the front side of described data input cell corresponding at least one button 7126 of described indicating equipment.Clearly, described indicating equipment and corresponding button thereof can be positioned at any side (for example left and right, following) end.Equally, can use a plurality of (for example, two, one on a left side, another is on the right side) indication and pointing device, wherein, described a plurality of indications and pointing device collaborative work each other.The user can use his both hands to hold described equipment, and uses described button and described microphone simultaneously, is used for importing for example data of text by data entry system of the present invention.Described user can also use described indicating equipment and corresponding button thereof simultaneously.
Be appreciated that described data input cell also may be wirelessly connected to for example relevant device of described dull and stereotyped PC.Equally, described indicating equipment and/or its button can be together or are positioned at the either side of described electronic equipment separately.
According to one embodiment of present invention, the for example flexible display unit of OLED display can be provided, make that under closing state, described display unit has the form of wrist strap, it is by with on wearer's wrist or be connected on the wrist strap of wrist placement devices, and finally is connected to described equipment.Figure 72 a shows for example example of the wrist strap 7211 of the electronic equipment 7210 of wrist electronic equipment, and wherein, the described display unit that is in closed condition is connected to described band.Figure 72 b shows the described display unit 7215 that is in the state of pulling down.Figure 72 C shows the display unit 7215 that is in open mode.
According to one embodiment of present invention, for help system is distinguished between the voice of two symbols of the part of for example letters/words/word with roughly similar pronunciation better, first symbol of similar described symbol and less at least one different phone set that is similar to other symbols can be assigned to described first symbol roughly, make that the chance of discerning described symbol by sound recognition system has improved when the user says described first symbol.For example, if letter " d " is assigned to the identical of same key with letter " b " and is scheduled to alternately, except phone set " de ", another similar phone set " te " (in this example, another button being distributed in letter " t ") also may be assigned to the voice of letter " d ".On the other hand, except phone set " be ", also distribute another similar phone set " pe " (in this example, another button being distributed in letter " p ").Letter " b " and " d " has roughly similarly pronunciation, but letter " t " (phone set " te ") is very significant different with the pronunciation of " p ".For example, if the user presses corresponding to the button of letter " b " and " d " and says " de ", system's possible errors is discerned described voice and is " te ".In this case, system will provide and distribute to the character of pressing the described voice that combine with described button, and letter " d " is provided.Be appreciated that the example that provides only is used to describe this embodiment here.Those skilled in the art can consider according to described principle, phoneme/phone set are assigned to the various configurations and the distribution of the part of any letters/words/word.
The system of describing in the application and other applications by inventor's submission, feature, enhancing etc. can be applied to all embodiment of the present invention.Equally, embodiments of the invention can work independently or carry out work in conjunction with the one or more embodiment of the present invention.
Therefore, when illustrating and describe and having pointed out when being applied to the of the present invention basic novel feature of optional embodiment, be appreciated that, those skilled in the art can carry out multiple omission and alternative and change to the form and the details of disclosure invention under the situation that does not depart from spirit of the present invention.Therefore, the present invention only is subjected to the spiritual pointed restriction by additional claim.Be appreciated that diagram needn't draw in proportion, but in itself, they only are notional.
For example, though in different embodiment, use the telephong type keypad to be used to represent different embodiments of the invention, clearly, the keypad of any kind of symbol configuration with any kind of the button of distributing to described keypad can be used for embodiments of the invention.
Because be not the principle that frequently repeats data entry system of the present invention, in many paragraphs of the application, mention, can give (for example, corresponding) button (or except other objects of the button) one or more allocation of symbols of a part/function of for example character/word/word etc.Be appreciated that the principle according to the data entry system of explaining in many other embodiment, conventional letter is by importing alternately with the predetermined of button.For example, preferred unless otherwise stated, can by may press at (as in many embodiment of the present invention, explaining) single on the described button with as described in button predetermined the easiest to be mutual, import described symbol.Equally, in many paragraphs, (for example explaining the symbol of for example letter/phone set/character (letter) collection/alphabetic string/wait, usually the symbol that will be said) distribute to after the button, for fear of the principle of the data entry system of the present invention that is recycled and reused for the described symbol of input, described principle can no longer be mentioned.Be appreciated that, unless otherwise stated, clearly, (as explaining in the many embodiment of the present invention) is preferred, by on respective keys, pressing action accordingly simultaneously in conjunction with voice corresponding to described symbol, symbol (for example, the symbol that will be said usually) to described type is imported.
Must be noted that in many paragraphs of the application, term " character set " or " character-collection " have been used for the definition character string.
Though in different embodiments of the invention, sound recognition system is mentioned, or wish to be used to perception and discern user's voice, but, except described sound recognition system or as the substituting of described sound recognition system, the labiomaney system can be used to perception and identification described user's voice (and vice versa).
Claims (1)
1. data entry system, it comprises:
Defined the keypad of a plurality of buttons, wherein, each button comprises full symbol less of glossary of symbols, and described glossary of symbols is divided into the child group that comprises at least one alphabet symbol, numeric character and order symbol, wherein, each son group is associated with at least a portion of user's finger; And
At least one of a kind of and described a plurality of buttons pressed the finger recognition system of one-key communication, wherein, described at least one button has first symbol of organizing from first son at least, and second symbol of organizing from second son at least, wherein, described finger recognition system is configured to when described finger and described button are mutual, described part to described user's finger is discerned, thus to corresponding to the described button of the child group of the described part correlation connection of described user's finger on described symbol select.
Applications Claiming Priority (15)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US46384403P | 2003-04-18 | 2003-04-18 | |
| US60/463,844 | 2003-04-18 | ||
| US60/466,594 | 2003-04-30 | ||
| US60/468,028 | 2003-05-05 | ||
| US60/474,447 | 2003-05-30 | ||
| US60/475,533 | 2003-06-03 | ||
| US60/482,706 | 2003-06-26 | ||
| US60/482,998 | 2003-06-27 | ||
| US60/496,702 | 2003-08-20 | ||
| US60/500,602 | 2003-09-05 | ||
| US60/504,331 | 2003-09-19 | ||
| US60/510,885 | 2003-10-14 | ||
| US60/536,564 | 2004-01-14 | ||
| US60/552,968 | 2004-03-11 | ||
| US60/557,140 | 2004-03-26 |
Related Child Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012104600922A Division CN103076886A (en) | 2003-04-18 | 2004-04-19 | Systems to enhance data entry in mobile and fixed environment |
| CN2011101119283A Division CN102200832A (en) | 2003-04-18 | 2004-04-19 | System to enhance data entry in mobile and fixed environment |
| CN2011101120350A Division CN102200841A (en) | 2003-04-18 | 2004-04-19 | System to enhance data entry in mobile and fixed environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1809866A true CN1809866A (en) | 2006-07-26 |
Family
ID=36840976
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200480017215 Pending CN1809866A (en) | 2003-04-18 | 2004-04-19 | Systems to enhance data entry in mobile and fixed environment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN1809866A (en) |
| ZA (1) | ZA200508462B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104053033A (en) * | 2014-06-30 | 2014-09-17 | 深圳市九洲电器有限公司 | Remote control input method and remote control |
| CN113096358A (en) * | 2021-04-09 | 2021-07-09 | 淄博职业学院 | Patient nursing auxiliary system based on Internet of things |
-
2004
- 2004-04-19 CN CN 200480017215 patent/CN1809866A/en active Pending
-
2005
- 2005-10-19 ZA ZA200508462A patent/ZA200508462B/en unknown
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104053033A (en) * | 2014-06-30 | 2014-09-17 | 深圳市九洲电器有限公司 | Remote control input method and remote control |
| CN113096358A (en) * | 2021-04-09 | 2021-07-09 | 淄博职业学院 | Patient nursing auxiliary system based on Internet of things |
| CN113096358B (en) * | 2021-04-09 | 2022-05-03 | 淄博职业学院 | Patient nursing auxiliary system based on Internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| ZA200508462B (en) | 2006-07-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1320492C (en) | Content management and distribution method | |
| AU2005253600B2 (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1864204A (en) | Methods, systems and programming for performing speech recognition | |
| CN1099629C (en) | Screen display key input unit | |
| US20070188472A1 (en) | Systems to enhance data entry in mobile and fixed environment | |
| US20160005150A1 (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1326308A (en) | Portable terminal, data inputting method, dictionary picking up method and device and media | |
| CN1554082A (en) | Features to enhance data entry through a small data entry unit | |
| CN1794159A (en) | Personalization of user accessibility options | |
| CN1494674A (en) | Touch-type key input apparatus | |
| CN101002455A (en) | System to enhance data entry in mobile and fixed environment | |
| CN1577227A (en) | Inputting key and inputting device | |
| CN1330810A (en) | Touch-typable devices based on ambiguous codes and method to design such devices | |
| US20150261429A1 (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1280748C (en) | Speed typing apparatus and method | |
| US11503144B2 (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1855223A (en) | Audio font output device, font database, and language input front end processor | |
| US20220360657A1 (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1809866A (en) | Systems to enhance data entry in mobile and fixed environment | |
| CN1287348C (en) | Stylus computer | |
| CN1324438C (en) | Appts. and method for inputting alphabet characters on keypad | |
| CN102200832A (en) | System to enhance data entry in mobile and fixed environment | |
| NZ552439A (en) | System to enhance data entry using letters associated with finger movement directions, regardless of point of contact | |
| CN101042617A (en) | Apparatus and method for inputting alphabet characters on keypad | |
| AU2012203372A1 (en) | System to enhance data entry in mobile and fixed environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: KEYLESS SYSTEMS LTD. Free format text: FORMER OWNER: GHASSABIAN BENJAMIN FIROOZ Effective date: 20120802 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20120802 Address after: Israel Jerusalem Applicant after: Keyless Systems Ltd. Address before: American New York Applicant before: Ghassabian Benjamin Firooz |
|
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20060726 |