CN103558943B - Realize the method and system of multi-modal synchronization input - Google Patents

Realize the method and system of multi-modal synchronization input Download PDF

Info

Publication number
CN103558943B
CN103558943B CN201310554067.5A CN201310554067A CN103558943B CN 103558943 B CN103558943 B CN 103558943B CN 201310554067 A CN201310554067 A CN 201310554067A CN 103558943 B CN103558943 B CN 103558943B
Authority
CN
China
Prior art keywords
input pattern
input
action
time
button
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310554067.5A
Other languages
Chinese (zh)
Other versions
CN103558943A (en
Inventor
竺博
胡金水
何婷婷
胡国平
胡郁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iFlytek Co Ltd
Original Assignee
iFlytek Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by iFlytek Co Ltd filed Critical iFlytek Co Ltd
Priority to CN201310554067.5A priority Critical patent/CN103558943B/en
Publication of CN103558943A publication Critical patent/CN103558943A/en
Application granted granted Critical
Publication of CN103558943B publication Critical patent/CN103558943B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Character Discrimination (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a kind of method and system realizing multi-modal synchronization input, the method includes: gathers the touch screen information of user's input, and chronologically touch screen information is recorded as two-dimensional coordinate point sequence;Determine that input pattern, described input pattern include according to described two-dimensional coordinate point sequence: key-press input pattern, handwriting input mode and button switching input pattern;According to described input pattern, described touch screen information is identified, is identified result;Judge whether to perform new input pattern;If it is, return the step performing to determine input pattern according to described two-dimensional coordinate point sequence;Otherwise keep current input mode.Utilize the present invention, it is possible to achieve the problem of the Freely input of the continuous word string of dissimilar character, improve input efficiency.

Description

Realize the method and system of multi-modal synchronization input
Technical field
The present invention relates to human-computer interaction technique field, be specifically related to a kind of method realizing multi-modal synchronization input And system.
Background technology
Conventional input systems typically can provide multiple input pattern, such as handwriting input and key-press input, but generally Different input patterns are individualisms, i.e. before input character user firstly the need of determining current input mould Formula: or with keyboard input or with handwriting input, and by received touch screen information according to default input Pattern resolves.Under such setting, user is when input is with the continuous word string of dissimilar character, Generally require and constantly adjust input pattern to meet the demand of kinds of characters type input, as to Chinese character Input switches to the handwriting mode input pattern being more accustomed to, and the input to English word or symbol then switches to Key mode inputs.On the one hand input pattern switching causes continuous word string entirety input efficiency low, separately frequently On the one hand user writing is experienced and is greatly reduced, and uses inconvenience, has bigger limitation.
This industry proposes a kind of method supporting multi-modal synchronization to input, and the method receives user at system The button at one interface or the touch screen information of handwriting input, carry out automatic decision and to touch screen information to input pattern Carry out related resolution and obtain corresponding content of text.The method achieve the letter under unified interface, numeral, The button operation of the characters such as symbol and the handwriting input of character.
But when needing by the character of key-press input not at current unified interface, be not the most currently by During the status of a sovereign character of key, the method still completes specific firstly the need of manual switching to corresponding inputting interface again The input of character.Obvious such method still cannot realize complete synchronization input, with 9 input through keyboard circle As a example by face, carry out phonetic key-press input at interface shown in Fig. 1, if but need input numeral, just need manually Switch to the digital inputting interface shown in Fig. 2.
Summary of the invention
The embodiment of the present invention provides a kind of method and system realizing multi-modal synchronization input, existing to solve Multi-mode input system can not realize the problem of the Freely input of the continuous word string of dissimilar character, improves defeated Enter efficiency.
To this end, the embodiment of the present invention following technical scheme of offer:
A kind of method realizing multi-modal synchronization input, including:
Gather the touch screen information of user's input, and chronologically touch screen information is recorded as two-dimensional coordinate point sequence;
Determine that input pattern, described input pattern include according to described two-dimensional coordinate point sequence: key-press input mould Formula, handwriting input mode and button switching input pattern;
According to described input pattern, described touch screen information is identified, is identified result;
Judge whether to perform new input pattern;
If it is, return the step performing to determine input pattern according to described two-dimensional coordinate point sequence;Otherwise Keep current input mode.
Preferably, described according to described input pattern, described touch screen information is identified, is identified result Including:
If described input pattern is handwriting input mode, then described touch screen information is carried out handwriting recognition, obtain Take text word string;
If described input pattern is key-press input pattern, then determine correspondence according to the position of described touch screen information Enliven button, then obtain and described enliven the text word string that button is corresponding;
If described input pattern is button switches input pattern, then determine according to the position of described touch screen information With the non-position key in key mapping, then obtain character corresponding to described non-position key and on shield display.
Preferably, described determine that input pattern includes according to described two-dimensional coordinate point sequence:
The contact action judging user according to described two-dimensional coordinate point sequence is stroke action or presses action;
If stroke action, it is determined that there is the two of maximum moving distance in unit judgement detection time interval Direction d between sampled point;
If described direction d is in default direction scope dt, it is determined that switch input pattern for button; It it is otherwise handwriting input mode;
If pressing action, then obtain the second of setting judge in time T2 the accumulation movement of sampled point away from From;
If described second judges that the accumulation displacement of sampled point is more than the second judgement preset in time T2 Distance S2, it is determined that switch input pattern for button;
If described second judges the accumulation displacement of sampled point in time T2 less than or equal to the preset Two judging distance S2, and produce described second and judge having of the accumulation displacement of sampled point in time T2 The effect time is more than the second judgement time T2, it is determined that switch input pattern for button;Otherwise be defined as by Key input pattern.
Preferably, described judge user according to described two-dimensional coordinate point sequence contact action be stroke action also It is to press action to include:
Obtain first set and judge the accumulation displacement of sampled point in time T1;
If described first judges that the accumulation displacement of sampled point is more than the first judgement preset in time T1 Distance S1, it is determined that the contact action of user is that stroke moves, and otherwise determines that the contact action of user is to press Action.
Preferably, judge whether described in that performing new input pattern includes:
Judge current character end of input the most;
If it has ended, then determine and perform new input pattern;Otherwise determine and do not perform new input pattern.
Preferably, described judge that current character end of input the most includes:
When handwriting input mode, if user's lifts the time time threshold more than setting, and user The person's handwriting of input meets person's handwriting complete condition in the distribution writing region, it is determined that current character has inputted knot Bundle;
When key-press input pattern or button switch input pattern, shielding if had on character, determining current character End of input.
A kind of system realizing multi-modal synchronization input, including:
Acquisition module, for gathering the touch screen information of user's input, and is recorded as two by touch screen information chronologically Dimension coordinate point sequence;
Input pattern determines module, for determining input pattern according to described two-dimensional coordinate point sequence, described defeated Enter pattern to include: key-press input pattern, handwriting input mode and button switching input pattern;
Identification module, for being identified described touch screen information according to described input pattern, is identified knot Really;
Judge module, for judging whether to perform new input pattern;If it is, notify described input mould Formula determines that module performs to determine the operation of input pattern according to described two-dimensional coordinate point sequence;Otherwise notice is described Input pattern determines that module keeps output current input mode.
Preferably, described identification module includes:
First identification module, for when described input pattern is handwriting input mode, to described touch screen information Carry out handwriting recognition, obtain text word string;
Second identification module, for when described input pattern is key-press input pattern, believes according to described touch screen What the position of breath determined correspondence enlivens button, then obtains and described enlivens the text word string that button is corresponding;
3rd identification module, for when described input pattern is button switching input pattern, touching according to described The position of screen information determines the non-position key in same key mapping, then obtains character corresponding to described non-position key upper screen Display.
Preferably, described input pattern determines that module includes:
Action judge module, is stroke for the contact action judging user according to described two-dimensional coordinate point sequence Action is still pressed in action;
First determines module, is stroke action for the contact action judging user at described action judge module Time, there is the direction d between maximum moving distance two sampled point in determining unit judgement detection time interval;As The most described direction d is in default direction scope dt, it is determined that switch input pattern for button;It is otherwise Handwriting input mode;
Second determines module, is to press action for the contact action judging user at described action judge module Time, obtain second set and judge the accumulation displacement of sampled point in time T2;If described second sentences In break time T2, the accumulation displacement of sampled point is more than the second judging distance S2 preset, it is determined that for pressing Key switching input pattern;If described second judge in time T2 the accumulation displacement of sampled point less than or Equal to the second judging distance S2 preset, and produce described second and judge the accumulation of sampled point in time T2 The effective time of displacement is more than the second judgement time T2, it is determined that switch input pattern for button; Otherwise it is defined as key-press input pattern.
Preferably, described action judge module, adopt specifically for obtaining in first set judges time T1 The accumulation displacement of sampling point;And judge the accumulation displacement of sampled point in time T1 described first During more than the first judging distance S1 preset, determine that the contact action of user is that stroke moves, otherwise determine use The contact action at family is to press action.
Preferably, described judge module, specifically for judging current character end of input the most;If Terminate, it is determined that perform new input pattern;Otherwise determine and do not perform new input pattern.
Preferably, when handwriting input mode, if the time of lifting that described judge module judges user is more than Set time threshold, and user input person's handwriting meet person's handwriting complete condition in the distribution writing region, Then determine current character end of input;
When key-press input pattern or button switch input pattern, if described judge module judges have on character Screen then determines current character end of input.
What the embodiment of the present invention provided realizes the method and system of multi-modal synchronization input, according to user's input Touch screen information automatically determines input pattern, such that it is able to receive the key-press input of user and hand-written at same interface Person's handwriting inputs, and the button switching input of the user's status of a sovereign non-to button character, and realizes input word string Effectively resolve, it is achieved that the continuous input of word string, be effectively improved efficiency and the Consumer's Experience of overall input.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present application or technical scheme of the prior art, below will be to enforcement In example, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only Some embodiments described in the present invention, for those of ordinary skill in the art, it is also possible to according to these Accompanying drawing obtains other accompanying drawing.
Fig. 1 is phonetic key-press input interface schematic diagram in prior art;
Fig. 2 is digital keys inputting interface schematic diagram in prior art;
Fig. 3 is multi-mode inputting interface schematic diagram in the embodiment of the present invention;
Fig. 4 is the flow chart that the embodiment of the present invention realizes the method for multi-modal synchronization input;
Fig. 5 is scope schematic diagram in direction in the embodiment of the present invention;
Fig. 6 is the structural representation that the embodiment of the present invention realizes the system of multi-modal synchronization input;
Fig. 7 is a kind of concrete structure schematic diagram that in the embodiment of the present invention, input pattern determines module.
Detailed description of the invention
In order to make those skilled in the art be more fully understood that the scheme of the embodiment of the present invention, below in conjunction with the accompanying drawings With embodiment, the embodiment of the present invention is described in further detail.
Owing to stroke number alphabetical, numbers and symbols is less and similar character is many, handwriting input under normal circumstances Recognition effect is the most limited, thus tends to key-press input more.And due to the restriction of inputting interface size, no Often take same button with character such as letter, numeral, the symbol etc. of type, thus prior art is in input Need to carry out the switching at different interface during dissimilar symbol, to activate different types of button.
For the restriction to input word string type continuously of the existing multi-modal synchronization input method, the embodiment of the present invention Propose the method and system of a kind of new multi-modal synchronization input, be possible not only on same interface receive and use The key-press input at family and handwriting input, but also user can be received the button of inactive button is switched input Deng, and realize the effective parsing to input word string by automatic decision, it is achieved that the continuous input of word string.
The embodiment of the present invention realizes a kind of inputting interface such as Fig. 3 institute of multi-modal synchronization input method and system Show.
In embodiments of the present invention, input pattern includes: key-press input pattern, handwriting input mode and press Key switching input pattern, described button switching input pattern has referred to inactive button (such as " abc " in Fig. 3 Keys upwards non-status of a sovereign character " 2 ") input.
As shown in Figure 4, it is the embodiment of the present invention flow chart of method that realizes multi-modal synchronization input, including Following steps:
Step 401, gathers the touch screen information of user's input, and touch screen information is recorded as two dimension seat chronologically Punctuation sequence.
Such as, (x, y), wherein x, y are respectively touch screen information to be recorded as two-dimensional coordinate point sequence chronologically The abscissa of each sampled point and vertical coordinate.
According to described two-dimensional coordinate point sequence, step 402, determines that input pattern, described input pattern include: Key-press input pattern, handwriting input mode and button switching input pattern.
Specifically, can according to the contact action that described two-dimensional coordinate point sequence judges user be stroke action also It is to press action.If stroke action, it is determined that the input pattern that described stroke action is corresponding is hand-written defeated Enter pattern or button switching input pattern;If pressing action, it is determined that described in press corresponding defeated of action Entering pattern is key-press input pattern or button switching input pattern.
In general, when user does stroke action, the person's handwriting displacement collected in the unit interval is longer, And user is when pressing action, in the unit interval, on touch screen, person's handwriting displacement is the shortest.Therefore, exist In actual application, first can determine that user moves according to touch screen information displacement within the unit interval Make.
Specifically, can in default judgement time T1, to time per unit (the usual T1=n* unit interval, Each unit interval can be 100ms.Sample in) compare sampled point accumulation displacement S and judge away from Relation from S1.If S > S1, it is determined that for stroke action;Otherwise for pressing action.
Under being judged as stroke action state, the user's touch screen information collected often has bigger displacement, The input pattern of its correspondence may be handwriting input mode or button switching input pattern (because button switching defeated Enter mode and also there is certain time stroke action, and have such possible: user keeps contact condition And stay for some time).In this case, in addition it is also necessary to further discriminate between handwriting input mode or by Key switching input pattern.
Generally there is its specific writing rules due to handwritten character stroke, and button switching input is generally by system Pre-set, therefore, according to the presentation direction feature of stroke, it can be distinguished in embodiments of the present invention. Specifically, it can be determined that in unit judgement detection time interval, direction between maximum moving distance two sampled point occurs D and the relation of direction scope dt, if d is in scope dt of direction, it is judged that switch input pattern for button; Otherwise it is judged as handwriting input mode.
Pressing under operating state being judged as, the displacement of the user's touch screen information collected is typically small, and it is right The input pattern answered is probably key-press input pattern or button switching input pattern.In this case, also need Further discriminate between key-press input pattern or button switching input pattern.
Due under key-press input pattern, user contact that time of specific keys is the shortest and accumulation mobile away from From less, otherwise the key press time of button handover operation is the longest or accumulation displacement is bigger.To this end, In actual applications, from time of contact and shift length, it can be further discriminated between.Specifically, may be used With in default judgement time T2, to the sample in time per unit, compare sampled point accumulation displacement S and the relation of judging distance S2.If S > S2, it is determined that switch input pattern for button;If S≤S2 But the time producing this section of displacement has exceeded judgement time T2, it is determined that switch input pattern for button; Other situations (i.e. S≤S2 but produce the time of this section of displacement not less than T2) are all judged as that button is defeated Enter pattern.
It should be noted that be judged as pressing under operating state above-mentioned, the feelings terminated if there is a stroke Condition, is i.e. judged as key-press input pattern.
Step 403, is identified described touch screen information according to described input pattern, is identified result.
It is previously noted that in embodiments of the present invention, input pattern has three kinds, respectively: key-press input pattern, Handwriting input mode and button switching input pattern.For these three input pattern, phase can be respectively adopted The recognition method answered obtains recognition result.Specifically:
If input pattern is handwriting input mode, then described touch screen information being carried out handwriting recognition, it is right to obtain The text word string answered;
If input pattern is key-press input pattern, then determine the work of correspondence according to the position of described touch screen information Jump button, then obtains and described enlivens the text word string that button is corresponding;
If described input pattern is button switches input pattern, then determine according to the position of described touch screen information With the non-position key in key mapping, then obtain character (such as letters/symbols/numeral) corresponding to described non-position key and Upper screen shows.
Step 404, it may be judged whether perform new input pattern;If it is, perform step 402;Otherwise, Perform step 405.
Step 405, keeps current input mode.
It should be noted that above-mentioned each parameter can be arranged when system initialization, including the first judgement time T1, second judge time T2, once judge time interval t, the first judging distance S1, second judge away from From S2, direction scope dt.In general, the setting of these parameters depends on the size of display screen sample rate, The speed of hardware processor and the framework etc. of systems soft ware.In actual applications, it is contemplated that user writes Experience and actual effect, can judge that time T1 is taken as 200ms by first;Second judges that time T2 takes For 500ms;Once judge that time interval t is taken as 50ms;First judging distance S1 is 20 pixels; Second judging distance S2 is 30 pixels;Direction scope dt is (75 °, 105 °), as black in Fig. 6 Shown in territory, zone.
As can be seen here, what the embodiment of the present invention provided realizes the method that multi-modal synchronization inputs, defeated according to user The touch screen information entered automatically determines input pattern, and described input pattern includes: key-press input pattern, hands Write input pattern and button switching input pattern, such that it is able to receive the key-press input of user at same interface Input with handwriting, and the button switching input of the user's status of a sovereign non-to button character, and realize input Effective parsing of word string, it is achieved that the continuous input of word string, is effectively improved efficiency and the use of overall input Family is experienced.
Correspondingly, the embodiment of the present invention also provides for a kind of system realizing multi-modal synchronization input, such as Fig. 6 institute Show, be a kind of structural representation of this system.
In this embodiment, described system includes:
Acquisition module 601, for gathering the touch screen information of user's input, and chronologically by touch screen information record For two-dimensional coordinate point sequence;
Input pattern determines module 602, for determining input pattern according to described two-dimensional coordinate point sequence, and institute State input pattern to include: key-press input pattern, handwriting input mode and button switching input pattern;
Identification module 603, for being identified described touch screen information according to described input pattern, is known Other result;
Judge module 604, for judging whether to perform new input pattern;If it is, notify described defeated Enter mode decision module and perform to determine according to described two-dimensional coordinate point sequence the operation of input pattern;Otherwise notify Described input pattern determines that module exports current input mode.
In this embodiment, input pattern determines module 602 to need first to determine that the contact action of user is pen Action is still pressed in picture action, and then determines the concrete input pattern in the case of different action again.To this end, it is defeated The one entering mode decision module 602 implement structure as it is shown in fig. 7, comprises: action judge module 701, first determines that module 702 and second determines module 703.Wherein:
Action judge module 701, for the contact action judging user according to described two-dimensional coordinate point sequence be Stroke action still presses action;
First determines module 702, for the contact action judging user at described action judge module 701 is During stroke action, in determining unit judgement detection time interval, there is the side between maximum moving distance two sampled point To d;If described direction d is in default direction scope dt, it is determined that switch input pattern for button; It it is otherwise handwriting input mode;
Second determines module 703, for the contact action judging user at described action judge module 701 is When pressing action, obtain second set and judge accumulation displacement S of sampled point in time T2;If Described accumulation displacement S is more than the second judging distance S2 preset, it is determined that for button switching input mould Formula;If described accumulation displacement S is less than or equal to the second judging distance S2 preset, and produces The effective time of this section of displacement is more than T2, it is determined that switch input pattern for button;Otherwise determine For key-press input pattern.
Above-mentioned action judge module 701 specifically can determine that the contact action of user is stroke in the following manner Action is still pressed in action: obtains first set and judges accumulation displacement S of sampled point in time T1; And when described accumulation displacement is more than the first judging distance S1 preset, determine the touch screen behaviour of user Work is that stroke moves, and otherwise determines that the contact action of user is to press action.
It should be noted that above-mentioned input pattern determines that module 602 is not limited in structure shown in Fig. 7, In actual application, it is also possible to use other version, this embodiment of the present invention is not limited.
It addition, in embodiments of the present invention, it is judged that module 604 specifically can be the most defeated according to current character Enter and terminate to determine whether to perform new input pattern.If it has ended, then determine and perform new input pattern; Otherwise determine and do not perform new input pattern.Specifically, when handwriting input mode, it is judged that module 604 If judging that user's lifts the time time threshold more than setting, and the person's handwriting of user's input writing district The distribution in territory meets person's handwriting complete condition, it is determined that current character end of input;In key-press input pattern or During button switching input pattern, it is judged that module 604 judges, if having on character and shielding, to determine that current character is the most defeated Enter to terminate.
In embodiments of the present invention, identification module 603 can be carried out according to the different input patterns of user accordingly Text region.Specifically, identification module 603 may include that
First identification module, for when described input pattern is handwriting input mode, to described touch screen information Carry out handwriting recognition, obtain text word string;
Second identification module, for when described input pattern is key-press input pattern, believes according to described touch screen What the position of breath determined correspondence enlivens button, then obtains and described enlivens the text word string that button is corresponding;
3rd identification module, for when described input pattern is button switching input pattern, touching according to described The position of screen information determines the non-position key in same key mapping, then obtains character corresponding to described non-position key upper screen Display.
What the embodiment of the present invention provided realizes the system of multi-modal synchronization input, according to the touch screen letter of user's input Breath automatically determines input pattern, and described input pattern includes: key-press input pattern, handwriting input mode And button switching input pattern, such that it is able to receive key-press input and the handwriting of user at same interface Input, and the button switching input of the user's status of a sovereign non-to button character, and realize inputting the effective of word string Resolve, it is achieved that the continuous input of word string, be effectively improved efficiency and the Consumer's Experience of overall input.
Each embodiment in this specification all uses the mode gone forward one by one to describe, phase homophase between each embodiment As part see mutually, what each embodiment stressed is different from other embodiments it Place.For system embodiment, owing to it is substantially similar to embodiment of the method, so describing Fairly simple, relevant part sees the part of embodiment of the method and illustrates.System described above is implemented Example is only that schematically the wherein said unit illustrated as separating component can be or may not be Physically separate, the parts shown as unit can be or may not be physical location, the most permissible It is positioned at a place, or can also be distributed on multiple NE.Can select according to the actual needs Some or all of module therein realizes the purpose of the present embodiment scheme.Those of ordinary skill in the art exist In the case of not paying creative work, i.e. it is appreciated that and implements.
Being described in detail the embodiment of the present invention above, detailed description of the invention used herein is to this Bright being set forth, the explanation of above example is only intended to help to understand the method and apparatus of the present invention;With Time, for one of ordinary skill in the art, according to the thought of the present invention, in detailed description of the invention and application All will change in scope, in sum, this specification content should not be construed as limitation of the present invention.

Claims (12)

1. the method realizing multi-modal synchronization input, it is characterised in that including:
Gather the touch screen information of user's input, and chronologically touch screen information is recorded as two-dimensional coordinate point sequence;
Determine that input pattern, described input pattern include according to described two-dimensional coordinate point sequence: key-press input mould Formula, handwriting input mode and button switching input pattern;
According to described input pattern, described touch screen information is identified, is identified result;
Judge whether to perform new input pattern;
If it is, return the step performing to determine input pattern according to described two-dimensional coordinate point sequence;Otherwise Keep current input mode.
Method the most according to claim 1, it is characterised in that described according to described input pattern pair Described touch screen information is identified, and is identified result and includes:
If described input pattern is handwriting input mode, then described touch screen information is carried out handwriting recognition, obtain Take text word string;
If described input pattern is key-press input pattern, then determine correspondence according to the position of described touch screen information Enliven button, then obtain and described enliven the text word string that button is corresponding;
If described input pattern is button switches input pattern, then determine according to the position of described touch screen information With the non-position key in key mapping, then obtain character corresponding to described non-position key and on shield display.
Method the most according to claim 1, it is characterised in that described according to described two-dimensional coordinate point Sequence determines that input pattern includes:
The contact action judging user according to described two-dimensional coordinate point sequence is stroke action or presses action;
If stroke action, it is determined that there is the two of maximum moving distance in unit judgement detection time interval Direction d between sampled point;
If described direction d is in default direction scope dt, it is determined that switch input pattern for button; It it is otherwise handwriting input mode;
If pressing action, then obtain the second of setting judge in time T2 the accumulation movement of sampled point away from From;
If described second judges that the accumulation displacement of sampled point is more than the second judgement preset in time T2 Distance S2, it is determined that switch input pattern for button;
If described second judges the accumulation displacement of sampled point in time T2 less than or equal to the preset Two judging distance S2, and produce described second and judge having of the accumulation displacement of sampled point in time T2 The effect time is more than the second judgement time T2, it is determined that switch input pattern for button;Otherwise be defined as by Key input pattern.
Method the most according to claim 3, it is characterised in that described according to described two-dimensional coordinate point Sequence judges that the contact action of user is stroke action or pressing action includes:
Obtain first set and judge the accumulation displacement of sampled point in time T1;
If described first judges that the accumulation displacement of sampled point is more than the first judgement preset in time T1 Distance S1, it is determined that the contact action of user is stroke action, otherwise determines that the contact action of user is a little By action.
Method the most according to claim 1, it is characterised in that described in judge whether to perform new defeated Enter pattern to include:
Judge current character end of input the most;
If it has ended, then determine and perform new input pattern;Otherwise determine and do not perform new input pattern.
Method the most according to claim 5, it is characterised in that described judge that current character is the most End of input includes:
When handwriting input mode, if user's lifts the time time threshold more than setting, and user The person's handwriting of input meets person's handwriting complete condition in the distribution writing region, it is determined that current character has inputted knot Bundle;
When key-press input pattern or button switch input pattern, shielding if had on character, determining current character End of input.
7. the system realizing multi-modal synchronization input, it is characterised in that including:
Acquisition module, for gathering the touch screen information of user's input, and is recorded as two by touch screen information chronologically Dimension coordinate point sequence;
Input pattern determines module, for determining input pattern according to described two-dimensional coordinate point sequence, described defeated Enter pattern to include: key-press input pattern, handwriting input mode and button switching input pattern;
Identification module, for being identified described touch screen information according to described input pattern, is identified knot Really;
Judge module, for judging whether to perform new input pattern;If it is, notify described input mould Formula determines that module performs to determine the operation of input pattern according to described two-dimensional coordinate point sequence;Otherwise notice is described Input pattern determines that module keeps output current input mode.
System the most according to claim 7, it is characterised in that described identification module includes:
First identification module, for when described input pattern is handwriting input mode, to described touch screen information Carry out handwriting recognition, obtain text word string;
Second identification module, for when described input pattern is key-press input pattern, believes according to described touch screen What the position of breath determined correspondence enlivens button, then obtains and described enlivens the text word string that button is corresponding;
3rd identification module, for when described input pattern is button switching input pattern, touching according to described The position of screen information determines the non-position key in same key mapping, then obtains character corresponding to described non-position key upper screen Display.
System the most according to claim 7, it is characterised in that described input pattern determines module bag Include:
Action judge module, is stroke for the contact action judging user according to described two-dimensional coordinate point sequence Action is still pressed in action;
First determines module, is stroke action for the contact action judging user at described action judge module Time, there is the direction d between maximum moving distance two sampled point in determining unit judgement detection time interval;As The most described direction d is in default direction scope dt, it is determined that switch input pattern for button;It is otherwise Handwriting input mode;
Second determines module, is to press action for the contact action judging user at described action judge module Time, obtain second set and judge the accumulation displacement of sampled point in time T2;If described second sentences In break time T2, the accumulation displacement of sampled point is more than the second judging distance S2 preset, it is determined that for pressing Key switching input pattern;If described second judge in time T2 the accumulation displacement of sampled point less than or Equal to the second judging distance S2 preset, and produce described second and judge the accumulation of sampled point in time T2 The effective time of displacement is more than the second judgement time T2, it is determined that switch input pattern for button; Otherwise it is defined as key-press input pattern.
System the most according to claim 9, it is characterised in that
Described action judge module, judges tiring out of sampled point in time T1 specifically for obtaining first set Long-pending displacement;And judge that the accumulation displacement of sampled point is more than presetting in time T1 described first The first judging distance S1 time, determine that the contact action of user is stroke action, otherwise determine user touch Screen operation is to press action.
11. systems according to claim 7, it is characterised in that
Described judge module, specifically for judging current character end of input the most;If it has ended, then Determine and perform new input pattern;Otherwise determine and do not perform new input pattern.
12. systems according to claim 11, it is characterised in that
When handwriting input mode, if described judge module judge user lift a time more than set time Between threshold value, and user input person's handwriting meet person's handwriting complete condition in the distribution writing region, it is determined that when Front character end of input;
When key-press input pattern or button switch input pattern, if described judge module judges have on character Screen then determines current character end of input.
CN201310554067.5A 2013-11-08 2013-11-08 Realize the method and system of multi-modal synchronization input Active CN103558943B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310554067.5A CN103558943B (en) 2013-11-08 2013-11-08 Realize the method and system of multi-modal synchronization input

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310554067.5A CN103558943B (en) 2013-11-08 2013-11-08 Realize the method and system of multi-modal synchronization input

Publications (2)

Publication Number Publication Date
CN103558943A CN103558943A (en) 2014-02-05
CN103558943B true CN103558943B (en) 2016-08-17

Family

ID=50013218

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310554067.5A Active CN103558943B (en) 2013-11-08 2013-11-08 Realize the method and system of multi-modal synchronization input

Country Status (1)

Country Link
CN (1) CN103558943B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106775373B (en) * 2016-11-15 2019-12-03 北京小米移动软件有限公司 The management method and device of soft keyboard
CN107256124B (en) * 2017-04-21 2023-01-10 海信视像科技股份有限公司 Electronic whiteboard touch control method and device
CN109213412A (en) * 2017-07-03 2019-01-15 北京搜狗科技发展有限公司 Input method, device and machine readable media
CN108037875B (en) * 2017-12-12 2020-06-02 北京小米移动软件有限公司 Method, device and storage medium for switching input modes
CN112235458B (en) * 2020-10-14 2021-06-18 珠海格力电器股份有限公司 Device sleep control method, device and computer readable medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184074A (en) * 2011-04-21 2011-09-14 安徽科大讯飞信息科技股份有限公司 Keyboard, automatic hand input switching method and device and mobile terminal
CN102193736A (en) * 2011-04-21 2011-09-21 安徽科大讯飞信息科技股份有限公司 Input method and system supporting multimode automatic switching
CN103218168A (en) * 2013-04-09 2013-07-24 广东欧珀移动通信有限公司 Input method switching method and device
CN103294175A (en) * 2012-02-27 2013-09-11 联想(北京)有限公司 Electronic device and method for electronic device to automatically switch input modes

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010205069A (en) * 2009-03-04 2010-09-16 Panasonic Corp Input device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184074A (en) * 2011-04-21 2011-09-14 安徽科大讯飞信息科技股份有限公司 Keyboard, automatic hand input switching method and device and mobile terminal
CN102193736A (en) * 2011-04-21 2011-09-21 安徽科大讯飞信息科技股份有限公司 Input method and system supporting multimode automatic switching
CN103294175A (en) * 2012-02-27 2013-09-11 联想(北京)有限公司 Electronic device and method for electronic device to automatically switch input modes
CN103218168A (en) * 2013-04-09 2013-07-24 广东欧珀移动通信有限公司 Input method switching method and device

Also Published As

Publication number Publication date
CN103558943A (en) 2014-02-05

Similar Documents

Publication Publication Date Title
CN103558943B (en) Realize the method and system of multi-modal synchronization input
CN103353828B (en) The method and device of function is write and is wiped in a kind of switching on the touchscreen
KR101915444B1 (en) Using pressure differences with a touch-sensitive display screen
US20090046110A1 (en) Method and apparatus for manipulating a displayed image
US20140123049A1 (en) Keyboard with gesture-redundant keys removed
KR20030019619A (en) Text entry method and device therefor
CN103246437A (en) Approach for switching input methods and terminal
US20070298849A1 (en) Keypad touch user interface method and a mobile terminal using the same
EP2404230A1 (en) Improved text input
CN102750106B (en) Full frame handwriting recognition input method and system
CN101609380A (en) A kind of on touch-screen the file method of operating
US9292202B2 (en) Client device, operating method, and recording medium
CN102135838A (en) Method and system for partitioned input of handwritten character string
CN102169391A (en) Input device and input method of touch device
CA2837752A1 (en) Graphic object selection by way of directional swipe gestures
CN102339211A (en) Pinyin six-sliding input method
CN103186268A (en) Handwriting input method and system
CN102023806B (en) Input method for touch screen
KR20100033214A (en) Automatic switching method of input-mode by input pattern
CN101996020A (en) Method and device for displaying virtual keyboard
CN107608617A (en) A kind of characters by touch screen input and amending method
KR101257760B1 (en) Method for inputting characters by drag
KR20110131575A (en) Method and apparatus for inputting characters by drag and recording medium storing a program to execute thereof
KR20090047257A (en) Method of inputting characters using software keyboard
US20070028019A1 (en) Method and apparatus for efficient text entry in cell phones and other small keypad devices

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Wangjiang Road high tech Development Zone Hefei city Anhui province 230088 No. 666

Applicant after: Iflytek Co., Ltd.

Address before: Wangjiang Road high tech Development Zone Hefei city Anhui province 230088 No. 666

Applicant before: Anhui USTC iFLYTEK Co., Ltd.

COR Change of bibliographic data
C14 Grant of patent or utility model
GR01 Patent grant