Summary of the invention
In order to overcome the restriction of above-mentioned prior art, and overcome through reading and understanding other restriction that this instructions will be understood, the present invention proposes a kind of user interface, equipment and method, to be used for handwriting input.
First aspect of the present invention is a kind of equipment, comprises input media; Be configured to detect the quick display screen that touches of the character script of writing above that by said input media; And touch the treating apparatus that quick display screen is coupled and is configured to discern said character script with said; Wherein, Saidly touch quick display screen and comprise that the area that can eject with indentation consults window than the said little person's handwriting of quick display screen that touches; Said person's handwriting is consulted window and is applicable to and presents scaled said character script, consults as required for the user.
According to embodiments of the invention, said person's handwriting is consulted the correction that window is applicable to that acceptance is carried out said segmentation result, and treating apparatus is configured to upgrade the identification to said character script in response to said correction according to the segmentation result of being revised.
According to still another embodiment of the invention; Saidly touch quick display screen and further comprise candidate window; Said candidate window comprises candidate's phrase hurdle; It is configured to appear the candidate's list of phrases of being discerned corresponding to said character script, and focuses on any one character in any one the candidate's phrase in said candidate's list of phrases in response to user's input; And the candidate hurdle, it is used to appear the candidate character list of being discerned corresponding to the character that is focused on.
Equipment according to the present invention provides good user interactions, is convenient to user's operation, and helps improving the accuracy and the speed of handwriting input.
Second aspect of the present invention is a kind of method, comprises that detection touching the character script of writing on the quick display screen; Discern said character script; And as required, eject and be retracted within and saidly consult window at the area that touches on the quick display screen than the said little person's handwriting of quick display screen that touches, wherein, said person's handwriting is consulted window and is appeared and have scaled said character script.
According to embodiments of the invention, said method further is included in said person's handwriting and consults on the window said segmentation result is revised; And, upgrade identification to said character script according to the segmentation result of being revised in response to said correction.
According to still another embodiment of the invention; Said identification comprises estimates the candidate list of phrases corresponding with said character script; And the corresponding candidate character list of any one character in any one the candidate's phrase in estimation and the said candidate's list of phrases; And said method further comprises selects a phrase from said candidate's list of phrases; As whole identification phrase, perhaps from said candidate character list, select a character, as single identification character corresponding to said character script corresponding to said character script.
The third aspect of the invention is a kind of handwriting input user interface that is used for; Comprise and touch quick display screen; It is configured to detect the character script of being write by input media above that; Wherein, saidly touch quick display screen and comprise that the area that can eject with indentation consults window than the said little person's handwriting of quick display screen that touches, said person's handwriting is consulted window and is applicable to that presenting scaled said character script consults for the user as required.
Second of invention has identical with first aspect or corresponding feature and advantage basically with the third aspect.From following detailed open, appended dependent claims and accompanying drawing, other purposes of the present invention, feature and advantage will become clear.
Usually, according to all used terms in the general sense construe requirement in present technique field, only if carried out other clearly qualification here.Should be construed as denoting at least one example of said unit of generation, equipment, parts, device, step etc. to all descriptions of "/said (parts, equipment, composition, device, step etc.) " openly, clearly be described only if carried out in addition.The step of any method disclosed herein must not carried out with disclosed order, only if carried out clearly statement.
Embodiment
With reference to accompanying drawing, accompanying drawing forms the part of embodiment in the description of following each exemplary embodiment, and illustrates through diagram in the accompanying drawings and can put into practice each exemplary embodiment of the present invention.Should be understood that and can use other embodiment, and can carry out without departing from the scope of the invention on the structure with function on modification.
Terminological interpretation
Person's handwriting: expression is being touched the traces of characters integral body of writing on the quick display screen through the input media of for example writing pencil.
Stroke: in the traces of characters that expression is write on touching quick display screen through the input media of for example writing pencil independent one is the basic component part of character.
The component of person's handwriting: expression is made up of one or more strokes that are associated through cutting apart the part of the composition person's handwriting that person's handwriting obtains usually.
Segmentation result: when being illustrated in person's handwriting identification, person's handwriting is divided into one or more components, the respective components that wherein belongs to each character in the multiword symbol of being write can be divided into one group respectively, so that discern single character.This is divided into component by person's handwriting, and the result by component process gained in groups is exactly a segmentation result again.
For instance: write " woman ", " son " two characters on the quick display screen touching; The written trace
of representing these two characters is a person's handwriting; Write five altogether, then each pen is a stroke.When identification; This written trace possibly be divided into a component
to be discerned, and recognition result possibly be " good " like this; This written trace also possibly be divided into two components
to be discerned, and recognition result possibly be " woman " like this.This shows that two kinds of different segmentation results cause two kinds of different recognition results.
Fig. 1 shows the synoptic diagram according to the hand-written equipment 100 of the electronics of the embodiment of the invention.As known in the art, the hand-written equipment of electronics that is used for hand-written character input generally comprises three parts: be used to detect the quick display screen of touching of the person's handwriting write 110, be used for the input media 120 of written handwriting or input instruction and be used to carry out the treating apparatus 130 of data processing with the identification person's handwriting.
Touching quick display screen 110 can be the display screen that is applicable to any commercial available types of handwriting input.Input media 120 can be pen, writing pencil, perhaps other lip pencil things---comprise user's finger or other body parts.Treating apparatus 130 can be the combination of CPU (" CPU "), DSP (" digital signal processor ") or any other electronic programmable logical device or device.Certainly, the hand-written equipment of electronics can also comprise other device or parts, for example is used for the device of radio communication, the device that is used for wire communication, the device that is used to make a video recording, keyboard, loudspeaker, microphone or the like, but only describes the parts relevant with the present invention at this.
As known in the art, touch quick display screen 110 and not only be used for display visual information to the user, can also be used to receive hand-written character person's handwriting and instruction input.On most screen areas of this display screen 110, the user can want the character of importing or carry out instruction manipulation through using input media 120 to write it.Touch quick display screen 110 and can support multiword symbol input method according to of the present invention, and can a plurality of characters be write in a plurality of row of screen and (promptly support multirow to write).
Specifically, through on the display screen to be similar to the formal operations input media of on paper, writing 120, touch quick display screen 110 and can detect written handwriting, transfer it to electronic data and offer treating apparatus, by treating apparatus this person's handwriting is discerned.Finally; The character of being discerned---be that the user wants the character imported; Can be used as text message and be imported in the various application programs of electronic equipment 100, for example message application (for example email, SMS, MMS etc.), calendar application, phone book application, or the like.For example in the example shown in Fig. 1, the final character of discerning " good " is present on the row of dotted line indication.
In addition; Through on zones of different on the display screen 110 or window interface, clicking, rapping or dilatory input media 120; The user can be with writing pencil 250 as the interactive tool that is similar to the mouse in the computer; Control the character input of electronic input apparatus 100 through following operation, for example in the candidate character list option, select, on display screen 110, be provided with cursor the position, select Different control element (for example icon or button click) or the like.
Treating apparatus 130 with touch quick display screen and be coupled, can also can operate accordingly discerning from touching the detected written handwriting of quick display screen in response to the instruction that input media 120 is imported.
In traditional handwriting input process; Written handwriting is displayed on and touches on the quick display screen when user writing; But in case the end of writing of writing one or more characters of starting to write promptly once, written handwriting will be processed device and substitute through discerning the character that obtained (for example being presented at the character " good " on the represented row of dot-and-dash line among Fig. 1).In this case; In case user writing is started to write; The character script of being write before just can not checking again, a reason of design is that to touch the size of quick display screen usually very limited like this, not only needs the videotex application on the quick display screen touching after writing; Also need show some control windows, for example candidate character list option, control icon, button or menu.And the person's handwriting that stays when writing usually can occupy the major part (for example over half) of touching quick display screen or almost whole; Thereby write start to write after; If still touching reservation demonstration person's handwriting on the quick display screen; Will reduce and write the space, also might be because cause confusion easily with the demonstration overlaid of text application and control window.
For multicharacter input; Owing to once write a plurality of characters; And the multirow situation of writing (promptly once a plurality of characters of input are write respectively in the different row on touching quick display screen) especially, so person's handwriting is compared just bigger with the monocase input touching space occupied on the quick display screen.
According to the present invention, user interface---the person's handwriting query window 112 that can eject with indentation is set touching on the quick display screen.Person's handwriting is consulted the size of window 112 can be little more a lot of than touching quick display screen 110.When person's handwriting is consulted window 112 by At time of eject (being the situation shown in Fig. 1); The person's handwriting of just having write before appearing above that; Only with originally compare touching the quick display screen person's handwriting of writing of submitting a written statement to a higher authority, the size of the person's handwriting that window 112 is shown is by scaled---to touch quick display screen 110 little because person's handwriting is consulted the size ratio of window 112.When person's handwriting was consulted window 112 by indentation, it can be reduced into an icon, was in one jiao or side touching on the quick display screen 110, so that take the space of writing of touching on the quick display screen less as far as possible.Like this, the user can eject person's handwriting and consult window when needs are checked person's handwriting, and unwanted the time with its indentation.Thus, consult window through person's handwriting and can alleviate the limited space property problem of touching quick display screen to a certain extent, make and to consult the person's handwriting of being write after having write character, do not influence the use of writing space and other window interface simultaneously.
In addition, clerical error can appear in user sometimes unavoidably to be needed to revise, and perhaps need revise for the identification error of treating apparatus.And, might the user hope only to revise/revise some characters wherein but not all characters of being write.Like this,, discern, will help improving the accuracy and the recognition speed of person's handwriting identification so to amended person's handwriting if the user can consult the person's handwriting of being write and identify the handwriting and revise after once having write character.So further, consult on the window 112 at person's handwriting, the function that the person's handwriting under just having write is before revised is provided for the user.When person's handwriting is consulted window 112 by At time of eject; For example use input media 120; Can directly consult on the window the scaled person's handwriting that is shown is made amendment/revised, also can make amendment/revise this person's handwriting through other user's interface devices (for example keyboard) at this person's handwriting.And after-treatment device 130 will be to revising/revised person's handwriting renewal recognition result.For example, can be directly on the scaled person's handwriting that is shown, add or the deletion stroke to revise clerical error.Again for example, can identifying---the person's handwriting segmentation result to be revised in the middle of some of treating apparatus 130, this will describe in detail with reference to figure 3 after a while.
General handwriting input user interface can provide the candidate character list zone in order to improve the performance of user interface, wherein has a plurality of candidate characters to select for the user.These candidate characters are that the identification through treating apparatus 130 is handled, to the estimation of the corresponding character of the person's handwriting write and/or to association's prediction of the follow-up character that possibly import.Yet existing user interface only provides mostly with the multiword of being write and accords with the corresponding phrase of person's handwriting recognition result as a whole, and do not have other phrase as candidate's recognition result after the identification of multiword symbol.If the user has found identification error like this, can only check a plurality of candidate characters corresponding mostly with each hand-written character, therefrom select script to want the correct character of importing.
Therefore, another inventive arrangements of the present invention proposes candidate window to be set touching on the quick display screen 110, and candidate window comprises two parts: candidate's phrase hurdle 114 and candidate hurdle 116.The corresponding tabulation that comprises a plurality of candidate's phrases of multiword symbol person's handwriting that candidate's phrase hurdle 114 is used to appear and is write, and can instruct and focus on any one character in any one the candidate's phrase in said candidate's list of phrases in response to (for example directly click target that expection focuses on, cursor moved on the target that expection focuses on or the like that the mode that is fit to produces through keyboard, navigation bar etc. through input media 120) focusing.So, on candidate hurdle 116, present the candidate character list corresponding with the character that is focused on.Like this, can directly from a plurality of candidate's phrases, select and originally want the correct phrase imported, if having in candidate's list of phrases.If there is not right-on phrase in the candidate list; Then can select the phrase that is in the main true earlier; Focus on then in this phrase on the incorrect single character, from candidate hurdle 116, select the script corresponding again and want the correct character imported with this single character.After a while, will describe in detail and utilize candidate window to carry out the embodiment of operations such as the selection of phrase and single character, deletion, rewriting with reference to Figure 4 and 5 with mode intuitively.
Below with reference in the description of 2-5 to embodiments of the invention, the example of portable terminal, but also can use the hand-written equipment of electronics of other type as the hand-written equipment of electronics, for example have the PDA that touches quick display screen, palmtop computer etc.In addition, will use the example of SMS message in the following description, and it should be understood that other and use the technical scheme that also can be used for embodiment of the present invention as the application of using the hand-written character input.
Fig. 2 a-e illustrate according to the embodiment of the invention eject as required and the indentation person's handwriting is consulted the audio-visual picture of window.As shown in the figure, write (Fig. 2 a) down a plurality of characters " happier " touch quick display screen 110 right side arrow 2A through clicking (Fig. 2 b) afterwards, can eject (Fig. 2 c) person's handwriting and consult window 112.The scaled person's handwriting that presents " happier " four characters of just having write on the window 112.Can will make this window indentation (Fig. 2 e) through clicking (Fig. 2 d) arrow 2B again.Should understand; Control window 112 ejects and the mode (the for example above-mentioned operation 2A/2B that clicks arrow) of indentation is not a key element of the present invention; Also can use other control modes to control the ejection and the indentation of window 112, for example touch other menus or other buttons on the quick display screen through keyboard input instruction or use writing pencil click (comprising actions such as clicking, double-click, draw).
How Fig. 3 a-c is for example clear consults corrections identified the handwriting on the window segmentation result and thereby the audio-visual picture of renewal recognition result at person's handwriting.Shown in Fig. 3 a, consulting what appeared on the window 112 at person's handwriting is the person's handwriting that has just touched " happier " four characters of writing on the quick display screen 110.Suppose, can be divided into six components according to this person's handwriting of person's handwriting dividing function, each component for example as shown in the figure respectively by frame in an empty frame.Possible, because " power " in the stroke of " more " and " adding " is leaned on nearerly when writing, thereby cause when person's handwriting is cut apart, be divided in " more " and " power " in one group.Similar problem has also appearred in the person's handwriting for " soon " and " pleasure " two characters.So what estimate through recognition function at the beginning is " contain in the merit mouth " with the corresponding phrase of this multiword symbol person's handwriting, the phrase of wanting originally to import with the user does not conform to fully.
Shown in Fig. 3 b, can use for example writing pencil, come the component of being cut apart is drawn group again through the pen type gesture.A plurality of diversity that for example, can will belong to same character through belt pen type gesture as shown in the figure lump together.In this example, " power " and " mouth " is integrated into together and " adds " to form character, and the component of " soon " also is like this.Although not shown in the drawings, can be through the situation in groups of usage flag indication component, promptly which group is which component be divided in, make to component to draw group again more directly perceived.For example, can be along with drawing group again empty frame in the variation diagram, make be divided in component in same group by frame in same empty frame, distinguish different component group (being different characters) with empty frame.
After drawing group again, recognition result has become correct phrase " happier " from incorrect " contain the merit mouth ", shown in Fig. 3 c.Like this, consult window, can intuitively promptly revise the segmentation result of multiword symbol person's handwriting, obtain the user and want the correct character imported through person's handwriting.
Expect that easily the mode that character script is made amendment is not limited to form shown in Figure 3.For example, each component that can also use other pen type gesture will not belong to same character is separated, perhaps through a certain component of other operation deletion.
Be meant that in this belt pen type gesture of mentioning the geometric position of touching the mobile vestige on the quick display screen through writing pencil confirms that circle selects the operation of content, can use existing techniques in realizing.Conspicuous like ability and technician, the pen type gesture in the foregoing description is not to qualification of the present invention, can operate through other yet component is divided into groups again or identified the handwriting and carry out other correction.
As previously mentioned, existing multiword symbol is imported user interface or character ground identification one by one, selection, modification or deletion rewriting, or the identification of whole phrase ground, selection, modification or deletion rewriting.Thereby multiword symbol input efficiency is very low.And technical scheme of the present invention both can obtain the recognition result for the whole phrase corresponding with multiword symbol person's handwriting; Can obtain recognition result thus for corresponding single character; Thereby both allowed the user that whole phrase is selected, revised or deletes, allow the user that rewriting is selected, revises, deletes or inserted to single character again.
For these characteristics according to user interface of the present invention are described,, be that example is explained with the flow process of handwriting input Chinese sentence " wish everybody Happy Spring Festival the Lantern Festival is happier " with reference to Fig. 4 a-u.
Shown in Fig. 4 a, submit a written statement to a higher authority and write the person's handwriting of " wishing everybody " three characters touching quick display screen.Through the identification of treating apparatus, in candidate's phrase hurdle 114 of candidate window, present candidate's list of phrases.Shown in Fig. 4 b, candidate's list of phrases comprises that two candidate's phrase clauses and subclauses " wish everybody " and " looking everybody ".When first entry be just the user want to import multiword symbol phrase the time, can continue to write and need not to pause (shown in Fig. 4 c), at this moment said first entry " is wished everybody " and is defaulted as correct phrase, appears as the text of content of short message.
If not being the user, the first entry of the candidate's list of phrases that appears in candidate's phrase hurdle 114 do not want the correct phrase imported; And correct candidate's phrase is positioned on other position of this candidate's list of phrases, then can select from candidate's list of phrases, to select that correct phrase.Shown in Fig. 4 d-4f; On touching quick display screen, once write after the person's handwriting of (Fig. 4 d) following four characters " Happy Spring Festival "; Can use the input media of writing pencil for example to select (Fig. 4 e) to come the deputy phrase of candidate's list of phrases " Happy Spring Festival ", present (Fig. 4 f) with text as content of short message.
If there is not the user to want the correct phrase of importing in the candidate's list of phrases that appears in candidate's phrase hurdle 114; Then if not segmentation errors; Can select earlier and the correct essentially identical option phrase of phrase, and then select single correct character or write single character again through candidate hurdle 116.Avoid writing again the trouble of whole phrase like this.
Shown in Fig. 4 g-i; On touching quick display screen, once write after the person's handwriting of (Fig. 4 g) following three characters " Lantern Festival "; " the no stomach joint " that can select to appear in (Fig. 4 h) candidate's phrase hurdle 114; Although this phrase that to be not the user want imports, comparatively near correct phrase---for example comprise all that three characters and the 3rd character " joint " they are correct.Shown in Fig. 4 i; Can cursor be focused on above the character " nothing " in " the no stomach joint " from candidate's phrase hurdle 114, selected; So in candidate hurdle 116, present other candidate characters for character " nothing "; Originally want the correct character " unit " imported comprising the user, so just can from the candidate characters hurdle, select correct character " unit ".
If still there be not the correct candidate characters corresponding in the candidate hurdle with this single character, then can delete this single character, to write again, Fig. 4 j-o shows this situation.Shown in Fig. 4 j and 4k, during the character in focusing on candidate's phrase " stomach ", in the candidate hurdle, there is not correct candidate characters, so can delete character " stomach " (operation to backspace key 118 that wherein relates to will be specified with reference to figure 5 (b) after a while).Only stay " unit's joint " (Fig. 4 l) like this in the text content of short message.Shown in Fig. 4 m-o, written character " night " again, and character " night " is inserted between character " unit " and " joint ".
If there is segmentation errors, possibly not approach candidate's phrase of correct phrase in candidate's phrase hurdle 114 basically at all.So person's handwriting is consulted window 112 and can be ejected, checking the person's handwriting segmentation result, and on this window, the component of being cut apart is drawn group or other person's handwriting correction again, with the recognition result that has obtained to upgrade.Shown in Fig. 4 p-4u, the position (Fig. 4 p) that selection continues to write, and once write (Fig. 4 q) following four characters " happier ".Shown in Fig. 4 r and 4s, when in finding candidate's phrase hurdle 114, possibly not approach candidate's phrase of correct phrase basically, confirm it possibly is segmentation errors at all, consult window 112 so eject person's handwriting.Like this, can consult on the window at person's handwriting the component of segmentation errors is drawn group (Fig. 4 t) again.So, in candidate's phrase hurdle, demonstrate candidate's list of phrases (Fig. 4 u) of having upgraded, want the correct phrase of importing originally comprising the user.
The present invention attempts farthest to avoid again the trouble of stroke writing; For the situation of having to write again, can come to make handwriting input more convenient through the backspace key of once deleting whole phrase as required or once deleting single character because of clerical error as far as possible.Fig. 5 (a) shows the audio-visual picture according to the example of the whole phrase of deletion of the embodiment of the invention; Fig. 5 (b) shows the audio-visual picture according to the example of the single character of deletion of the embodiment of the invention.Shown in Fig. 5 (a); Three characters " handwritten form " have once been write afterwards; Backspace key 118 in the candidate window is in the form of
, can come entirely to delete this three characters through clicking it.Shown in Fig. 5 (b), after in the candidate hurdle, having carried out focus on selecting, backspace key 118 is in ← form, its function is just only effective to the single character of choosing, and can delete the single character of being chosen so click it.Only illustrate in the form of the backspace key shown in this 118 with to its mode of operation (promptly clicking), obviously it can adopt other any suitable form and mode of operation.
In the above-described embodiments, handwriting input be Chinese character, writing axis is level, and presentation direction is from left to right and line feed downwards.But should be understood that these are example, but not limitation of the present invention.Handwriting input also can be the character or the symbol of English character or other form.Writing axis and presentation direction also can be other, for example vertically, from the top down or the like.And said a plurality of characters of writing also can be write respectively in a plurality of row.In fact, these variations only relate to the variation to the RM of the person's handwriting that is detected, and can not influence the enforcement to technical scheme of the present invention.In addition, the present invention also can support the monocase input method.
Fig. 6 is the process flow diagram according to the method that is used for handwriting input of the embodiment of the invention.At step S1, touching written character on the quick display screen.At step S2, detect at the person's handwriting that touches the character of being write on the quick display screen.At step S3, discern said character script.At step S4, as required, eject and consult window than the said little person's handwriting of quick display screen that touches at the said area that is touching on the quick display screen, wherein, said person's handwriting is consulted window and is presented scaled said Chinese character person's handwriting.Said person's handwriting is consulted window also can be write the space with increase by indentation.
The further embodiment according to the present invention, the segmentation result of correction/modification person's handwriting if desired, then this process proceeds to step S5, consults on the window at said person's handwriting said segmentation result is revised.Cutting apart of identifying the handwriting can be carried out in the process that character script is discerned, and also can carry out in response to needing to revise/revise the indication of person's handwriting.
So, in response to said correction, return step S3, upgrade identification according to the segmentation result of being revised to the character script of being write.
If do not need correction/modification person's handwriting segmentation result, can the step S6 candidate characters estimated, select the correct character that to import so from identifying.The further embodiment according to the present invention; Recognition step S 3 can comprise when identification write to character script the time; Estimate to accord with the corresponding candidate's list of phrases of person's handwriting with said multiword, and the corresponding candidate character list of any one character in any one the candidate's phrase in estimation and the said candidate's list of phrases.And, from said candidate's list of phrases, can directly select correct phrase (step S61), as the expection input character that accords with the whole phrase of person's handwriting corresponding to said multiword.Also can be from corresponding to selecting correct character (step S62) in the candidate character list of the single character selected candidate's phrase, as the expection input character of said single character.
In addition, the present invention can provide and the method corresponding apparatus, and said equipment is made up of various modules, and said module is provided for carrying out the function of said method.Module can partly be implemented as hardware, partly is embodied as software or the firmware (hardware and software combines) that can be carried out by the processor of for example controller, microprocessor or other computing equipment.The present invention can be used as computer program and is provided, and said product comprises specializes the computer-readable storage organization of this computer program code (just, software or firmware) to be used for being carried out by processor above that.
Above-mentioned handwriting input scheme proposed by the invention is as the hand-writing input method that strengthens, with the availability of improving mobile phone.Above-mentioned and below content in; Being input as example with Chinese character describes; But should be understood that except Chinese character the present invention also goes for the character of other type; The for example character (for example symbol) of the character of other Languages (for example English, Japanese, Korean or the like), other non-class of languages, or above-mentioned combination.Technology of the present invention in addition can be applied on the miscellaneous equipment of supporting the handwriting input user interface design, and for example this has the fixed telephone that touches quick display screen, computing machine, PDA(Personal Digital Assistant) etc.
Present invention resides in this explicitly or briefly disclosed any novel feature or these combination of features.Though, it will be understood by those skilled in the art that existence is to multiple change and the variation of said system with technology about comprising that the particular example of carrying out preference pattern of the present invention described the present invention.Therefore, the spirit and scope of the present invention quilt that should like enclosed in the claim to be set forth is explained widely.