Summary of the invention
In order to overcome the restriction of above-mentioned prior art, and overcome by reading and understanding other restriction that this instructions will be understood, the present invention proposes a kind of user interface, equipment and method, to be used for handwriting input.
A first aspect of the present invention is a kind of equipment, comprises input media; Be configured to detect the quick display screen that touches of the character script of writing thereon by described input media; And touch the treating apparatus that quick display screen is coupled and is configured to discern described character script with described, wherein, describedly touch quick display screen and comprise that the area that can eject with indentation consults window than the described little person's handwriting of quick display screen that touches, described person's handwriting is consulted window and is applicable to and presents scaled described character script, consults as required for the user.
According to embodiments of the invention, described person's handwriting is consulted the correction that window is applicable to that acceptance is carried out described segmentation result, and treating apparatus is configured in response to described correction to upgrade identification to described character script according to the segmentation result of being revised.
According to still another embodiment of the invention, describedly touch quick display screen and further comprise candidate window, described candidate window comprises candidate's phrase hurdle, it is configured to present the candidate's list of phrases of being discerned corresponding to described character script, and focuses in response to user input on any one character in any one candidate's phrase in described candidate's list of phrases; And the candidate hurdle, it is used to present the candidate character list of being discerned corresponding to the character that is focused on.
Equipment according to the present invention provides good user interactions, is convenient to user's operation, and helps improving the accuracy and the speed of handwriting input.
A second aspect of the present invention is a kind of method, comprises that detection touching the character script of writing on the quick display screen; Discern described character script; And as required, eject and be retracted within and describedly consult window at the area that touches on the quick display screen than the described little person's handwriting of quick display screen that touches, wherein, described person's handwriting is consulted window and is presented and have scaled described character script.
According to embodiments of the invention, described method further is included in described person's handwriting and consults on the window described segmentation result is revised; And, upgrade identification to described character script according to the segmentation result of being revised in response to described correction.
According to still another embodiment of the invention, described identification comprises estimates the candidate list of phrases corresponding with described character script, and the corresponding candidate character list of any one character in any one the candidate's phrase in estimation and the described candidate's list of phrases, and described method further comprises selects a phrase from described candidate's list of phrases, as whole identification phrase corresponding to described character script, perhaps from described candidate character list, select a character, as single identification character corresponding to described character script.
A third aspect of the present invention is a kind of handwriting input user interface that is used for, comprise and touch quick display screen, it is configured to detect the character script of being write by input media thereon, wherein, describedly touch quick display screen and comprise that the area that can eject with indentation consults window than the described little person's handwriting of quick display screen that touches, described person's handwriting is consulted window and is applicable to that presenting scaled described character script consults as required for the user.
Second of invention has identical with first aspect or corresponding feature and advantage basically with the third aspect.From following detailed open, appended dependent claims and accompanying drawing, other purposes of the present invention, feature and advantage will become clear.
Usually, explain all used terms in the claim according to the general sense in present technique field, unless carried out other clearly qualification here.Should be construed as denoting at least one example of described unit of generation, equipment, parts, device, step etc. to all descriptions of "/described (parts, equipment, composition, device, step etc.) ", unless carried out in addition clearly describing openly.The step of any method disclosed herein must not carried out with disclosed order, unless carried out clearly statement.
Embodiment
With reference to the accompanying drawings, accompanying drawing forms the part of embodiment in the description of following each exemplary embodiment, and illustrates by diagram in the accompanying drawings and can put into practice each exemplary embodiment of the present invention.Should be understood that and can use other embodiment, and can carry out without departing from the scope of the invention on the structure and function on modification.
Terminological interpretation
Person's handwriting: expression is being touched the traces of characters integral body of writing on the quick display screen by the input media of for example writing pencil.
Stroke: in the traces of characters that expression is write on touching quick display screen by the input media of for example writing pencil independent one is the basic component part of character.
The component of person's handwriting: expression is made of one or more strokes that are associated usually by cutting apart the part of the composition person's handwriting that person's handwriting obtains.
Segmentation result: when being illustrated in person's handwriting identification, person's handwriting is divided into one or more components, the respective components that wherein belongs to each character in the multiword symbol of being write can be divided into one group respectively, so that discern single character.This is divided into component by person's handwriting, and the result by component process gained in groups is exactly a segmentation result again.
For instance: write " woman ", " son " two characters on the quick display screen touching, represented the written trace of these two characters
Be person's handwriting, write five altogether, then each pen is a stroke.When identification, this written trace may be divided into a component
Discern, recognition result may be " good " like this; This written trace also may be divided into two components
Discern, recognition result may be " woman " like this.This shows that two kinds of different segmentation results cause two kinds of different recognition results.
Fig. 1 shows the synoptic diagram according to the hand-written equipment 100 of the electronics of the embodiment of the invention.As known in the art, the hand-written equipment of electronics that is used for hand-written character input generally comprises three parts: be used to detect touching quick display screen 110, be used for the input media 120 of written handwriting or input instruction and be used to carry out the treating apparatus 130 of data processing with the identification person's handwriting of the person's handwriting write.
Touching quick display screen 110 can be the display screen that is applicable to any commercial available types of handwriting input.Input media 120 can be pen, writing pencil, perhaps other lip pencil things---comprise user's finger or other body parts.Treating apparatus 130 can be the combination of CPU (" CPU (central processing unit) "), DSP (" digital signal processor ") or any other electronic programmable logical device or device.Certainly, the hand-written equipment of electronics can also comprise other device or parts, for example is used for the device of radio communication, the device that is used for wire communication, the device that is used to make a video recording, keyboard, loudspeaker, microphone or the like, but only describes the parts relevant with the present invention at this.
As known in the art, touch quick display screen 110 and not only be used for display visual information to the user, can also be used to receive hand-written character person's handwriting and instruction input.On most screen areas of this display screen 110, the user can want the character of importing or carry out instruction manipulation by using input media 120 to write it.Touch quick display screen 110 and can support multiword symbol input method according to of the present invention, and a plurality of characters can be write in a plurality of row of screen and (promptly support multirow to write).
Specifically, by on the display screen to be similar to the formal operations input media of on paper, writing 120, touch quick display screen 110 and can detect written handwriting, transfer it to electronic data and offer treating apparatus, by treating apparatus this person's handwriting is discerned.Finally, the character of being discerned---be that the user wants the character imported, can be used as text message and be imported in the various application programs of electronic equipment 100, for example message application (for example email, SMS, MMS etc.), calendar application, phone book application, or the like.For example in the example shown in Fig. 1, the final character of discerning " good " is present on the row of dotted line indication.
In addition, by on zones of different on the display screen 110 or window interface, clicking, rapping or dilatory input media 120, the user can be with writing pencil 250 as the interactive tool that is similar to the mouse in the computer, control the character input of electronic input apparatus 100 by following operation, for example in the candidate character list option, select, on display screen 110, be provided with cursor the position, select different control element (for example icon or button click) or the like.
Treating apparatus 130 with touch quick display screen and be coupled, can also can operate accordingly discerning from touching the detected written handwriting of quick display screen in response to the instruction that input media 120 is imported.
In traditional handwriting input process, written handwriting is displayed on and touches on the quick display screen when user writing, but in case the end of writing of writing one or more characters of starting to write promptly once, written handwriting will processing means substitutes by discerning the character that obtained (for example being presented at the character " good " on the represented row of dot-and-dash line among Fig. 1).In this case, in case user writing is started to write, the character script of being write before just can not checking again, She Ji a reason is that to touch the size of quick display screen usually very limited like this, not only need videotex to use on the quick display screen touching after writing, also need to show some control windows, for example candidate character list option, control icon, button or menu.And the person's handwriting that stays when writing usually can occupy the major part (for example over half) of touching quick display screen or almost whole; thereby write start to write after; if still touching reservation demonstration person's handwriting on the quick display screen; will reduce and write the space, also might be because cause confusion easily with the demonstration overlaid of text application and control window.
For multicharacter input, owing to once write a plurality of characters, and the multirow situation of writing (promptly once a plurality of characters of input are write respectively in the different row on touching quick display screen) especially, so person's handwriting is compared just bigger with the monocase input touching space occupied on the quick display screen.
According to the present invention, user interface---the person's handwriting query window 112 that can eject with indentation is set touching on the quick display screen.Person's handwriting is consulted the size of window 112 can be little more a lot of than touching quick display screen 110.When person's handwriting is consulted window 112 by At time of eject (being the situation shown in Fig. 1), the person's handwriting of just having write before presenting thereon, only with originally compare touching the quick display screen person's handwriting of writing of submitting a written statement to a higher authority, the size of the person's handwriting that window 112 is shown is by scaled---to touch quick display screen 110 little because person's handwriting is consulted the size ratio of window 112.When person's handwriting was consulted window 112 by indentation, it can be reduced into an icon, was in one jiao or side touching on the quick display screen 110, so that take the space of writing of touching on the quick display screen less as far as possible.Like this, the user can eject person's handwriting and consult window when needs are checked person's handwriting, and unwanted the time with its indentation.Thus, consult window by person's handwriting and can alleviate the limited space problem of touching quick display screen to a certain extent, make and to consult the person's handwriting of being write after having write character, do not influence the use of writing space and other window interface simultaneously.
In addition, clerical error can appear in user sometimes unavoidably to be needed to revise, and perhaps need revise for the identification error for the treatment of apparatus.And, might the user wish only to revise/revise some characters wherein but not all characters of being write.Like this,, discern, will help improving the accuracy and the recognition speed of person's handwriting identification so at amended person's handwriting if the user can consult the person's handwriting of being write and identify the handwriting and revise after once having write character.Therefore further, consult on the window 112, the function that the person's handwriting under just having write is before revised is provided for the user at person's handwriting.When person's handwriting is consulted window 112 by At time of eject, for example use input media 120, can directly consult on the window shown scaled person's handwriting is made amendment/revised, also can make amendment/revise this person's handwriting by other user's interface devices (for example keyboard) at this person's handwriting.And after-treatment device 130 will be at revising/revised person's handwriting renewal recognition result.For example, can be directly on shown scaled person's handwriting, add or the deletion stroke to revise clerical error.Again for example, can identifying---the person's handwriting segmentation result to be revised in the middle of some for the treatment of apparatus 130, this will describe in detail with reference to figure 3 after a while.
General handwriting input user interface can provide the candidate character list zone in order to improve the performance of user interface, wherein has a plurality of candidate characters to select for the user.These candidate characters are that the identification by treating apparatus 130 is handled, to the estimation of the corresponding character of the person's handwriting write and/or to association's prediction of the follow-up character that may import.Yet existing user interface only provides mostly with the multiword of being write and accords with the corresponding phrase of person's handwriting recognition result as a whole, and do not have other phrase as candidate's recognition result after the identification of multiword symbol.If the user has found identification error like this, can only check a plurality of candidate characters corresponding mostly with each hand-written character, therefrom select script to want the correct character of importing.
Therefore, another inventive arrangements of the present invention proposes candidate window to be set touching on the quick display screen 110, and candidate window comprises two parts: candidate's phrase hurdle 114 and candidate hurdle 116.The corresponding tabulation that comprises a plurality of candidate's phrases of multiword symbol person's handwriting that candidate's phrase hurdle 114 is used to present and is write, and can focus on any one character in any one candidate's phrase in described candidate's list of phrases in response to (for example directly click target that expection focuses on, cursor moved on the target that expection focuses on or the like that the mode that is fit to produces by keyboard, navigation bar etc. by input media 120) focusing instruction.So, on candidate hurdle 116, present the candidate character list corresponding with the character that is focused on.Like this, can directly from a plurality of candidate's phrases, select and originally want the correct phrase imported, if having in candidate's list of phrases.If there is not right-on phrase in the candidate list, then can select the phrase that is in the main true earlier, focus on then in this phrase on the incorrect single character, from candidate hurdle 116, select the script corresponding again and want the correct character imported with this single character.After a while, will describe in detail and utilize candidate window to carry out the embodiment of operations such as the selection of phrase and single character, deletion, rewriting with reference to Figure 4 and 5 in mode intuitively.
Below with reference in the description of 2-5 to embodiments of the invention, the example of portable terminal, but also can use the hand-written equipment of electronics of other type as the hand-written equipment of electronics, for example have the PDA that touches quick display screen, palmtop computer etc.In addition, will use the example of SMS message in the following description, it should be understood that other application also can be used to implement technical scheme of the present invention as the application of using the hand-written character input.
Fig. 2 a-e illustrate according to the embodiment of the invention eject as required and the indentation person's handwriting is consulted the audio-visual picture of window.As shown in the figure, write (Fig. 2 a) down a plurality of characters " happier " touch quick display screen 110 right side arrow 2A by clicking (Fig. 2 b) afterwards, can eject (Fig. 2 c) person's handwriting and consult window 112.The scaled person's handwriting that presents " happier " four characters of just having write on the window 112.Can will make this window indentation (Fig. 2 e) by clicking (Fig. 2 d) arrow 2B again.Should understand, control window 112 ejects and the mode (for example above-mentioned operation 2A/2B that clicks arrow) of indentation is not a key element of the present invention, also can use other control modes to control the ejection and the indentation of window 112, for example touch other menus or other buttons on the quick display screen by keyboard input instruction or use writing pencil click (comprising actions such as clicking, double-click, draw).
How Fig. 3 a-c for example understands at person's handwriting and consults corrections identified the handwriting on the window segmentation result and thereby the audio-visual picture of renewal recognition result.Shown in Fig. 3 a, consulting what presented on the window 112 at person's handwriting is the person's handwriting that has just touched " happier " four characters of writing on the quick display screen 110.Suppose, can be divided into six components according to this person's handwriting of person's handwriting dividing function, for example as shown in the figure each component respectively by frame in an empty frame.Possible, because " power " in the stroke of " more " and " adding " is leaned on nearerly when writing, thereby cause when person's handwriting is cut apart, " more " and " power " is divided in one group.Similar problem has also appearred in the person's handwriting for " soon " and " pleasure " two characters.So the phrase of estimating by recognition function at the beginning corresponding with this multiword symbol person's handwriting is " contain in the merit mouth ", the phrase of wanting originally to import with the user does not conform to fully.
Shown in Fig. 3 b, can use for example writing pencil, come the component of being cut apart is drawn group again by the pen type gesture.For example, a plurality of diversity that can will belong to same character by belt pen type gesture as shown in the figure lump together.In this embodiment, " power " and " mouth " is integrated into together and " adds " to form character, and the component of " soon " also is like this.Although not shown in the drawings, can indicate the situation in groups of component by usage flag, promptly which group is which component be divided in, make to component to draw group again more directly perceived.For example, can be along with drawing group again empty frame in the variation diagram, make be divided in component in same group by frame in same empty frame, distinguish different component group (being different characters) with empty frame.
After drawing group again, recognition result has become correct phrase " happier " from incorrect " contain the merit mouth ", shown in Fig. 3 c.Like this, consult window, can intuitively promptly revise the segmentation result of multiword symbol person's handwriting, obtain the user and want the correct character imported by person's handwriting.
Expect that easily the mode that character script is made amendment is not limited to form shown in Figure 3.For example, each component that can also use other pen type gesture will not belong to same character is separated, perhaps by a certain component of other operation deletion.
The pen type gesture of going in ring as mentioned herein is meant by writing pencil determines that in the geometric position of touching the mobile vestige on the quick display screen circle selects the operation of content, can use existing techniques in realizing.Conspicuous as ability and technician, the pen type gesture in the foregoing description is not a limitation of the invention, can operate by other yet component is divided into groups again or identified the handwriting and carry out other correction.
As previously mentioned, existing multiword symbol is imported user interface or is discerned, selects, revises or delete rewriting character by character, or the identification of whole phrase ground, selection, modification or deletion rewriting.Thereby multiword symbol input efficiency is very low.And technical scheme of the present invention both can obtain the recognition result for the whole phrase corresponding with multiword symbol person's handwriting, can obtain recognition result thus for corresponding single character, thereby both allowed the user that whole phrase is selected, revised or deletes, allow the user that rewriting is selected, revises, deletes or inserted to single character again.
For these features according to user interface of the present invention are described,, be that example illustrates with the flow process of handwriting input Chinese sentence " wish everybody Happy Spring Festival the Lantern Festival is happier " with reference to Fig. 4 a-u.
Shown in Fig. 4 a, submit a written statement to a higher authority and write the person's handwriting of " wishing everybody " three characters touching quick display screen.By the identification for the treatment of apparatus, in candidate's phrase hurdle 114 of candidate window, present candidate's list of phrases.Shown in Fig. 4 b, candidate's list of phrases comprises that two candidate's phrase clauses and subclauses " wish everybody " and " looking everybody ".When first entry be just the user want to import multiword symbol phrase the time, can continue to write and need not to pause (shown in Fig. 4 c), at this moment described first entry " is wished everybody " and is defaulted as correct phrase, presents as the text of content of short message.
If not being the user, the first entry of the candidate's list of phrases that presents in candidate's phrase hurdle 114 do not want the correct phrase imported, and correct candidate's phrase is positioned on other position of this candidate's list of phrases, then can select to select from candidate's list of phrases that correct phrase.Shown in Fig. 4 d-4f, on touching quick display screen, once write after the person's handwriting of (Fig. 4 d) following four characters " Happy Spring Festival ", can use the input media of writing pencil for example to select (Fig. 4 e) to come the deputy phrase of candidate's list of phrases " Happy Spring Festival ", present (Fig. 4 f) with text as content of short message.
If there is not the user to want the correct phrase of importing in the candidate's list of phrases that presents in candidate's phrase hurdle 114, then if not segmentation errors, can select earlier and the correct essentially identical option phrase of phrase, and then select single correct character or write single character again by candidate hurdle 116.Avoid writing again the trouble of whole phrase like this.
Shown in Fig. 4 g-i, on touching quick display screen, once write after the person's handwriting of (Fig. 4 g) following three characters " Lantern Festival ", " the no stomach joint " that can select to present in (Fig. 4 h) candidate's phrase hurdle 114, although this phrase that to be not the user want imports, comparatively near correct phrase---for example comprise all that three characters and the 3rd character " joint " they are correct.Shown in Fig. 4 i, cursor can be focused on above the character " nothing " in " the no stomach joint " from candidate's phrase hurdle 114, selected, so in candidate hurdle 116, present other candidate characters for character " nothing ", originally want the correct character " unit " imported comprising the user, so just can from the candidate characters hurdle, select correct character " unit ".
If still there be not the correct candidate characters corresponding in the candidate hurdle with this single character, then can delete this single character, to write again, Fig. 4 j-o shows this situation.Shown in Fig. 4 j and 4k, during the character in focusing on candidate's phrase " stomach ", in the candidate hurdle, there is not correct candidate characters, so can delete character " stomach " (operation to backspace key 118 that wherein relates to will be described in detail with reference to figure 5 (b) after a while).Only stay " unit's joint " (Fig. 4 l) like this in the text content of short message.Shown in Fig. 4 m-o, written character " night " again, and character " night " is inserted between character " unit " and " joint ".
If there is segmentation errors, may not approach candidate's phrase of correct phrase in candidate's phrase hurdle 114 substantially at all.So person's handwriting is consulted window 112 and can be ejected, checking the person's handwriting segmentation result, and on this window, the component of being cut apart is drawn group or other person's handwriting correction again, with the recognition result that has obtained to upgrade.Shown in Fig. 4 p-4u, the position (Fig. 4 p) that selection continues to write, and once write (Fig. 4 q) following four characters " happier ".Shown in Fig. 4 r and 4s, in the time of in finding candidate's phrase hurdle 114, may not approaching candidate's phrase of correct phrase substantially, determine it may is segmentation errors at all, consult window 112 so eject person's handwriting.Like this, can consult on the window at person's handwriting the component of segmentation errors is drawn group (Fig. 4 t) again.So, in candidate's phrase hurdle, demonstrate candidate's list of phrases (Fig. 4 u) of having upgraded, want the correct phrase of importing originally comprising the user.
The present invention attempts farthest to avoid again the trouble of stroke writing, for the situation of having to write again, can make handwriting input more convenient by the backspace key of once deleting whole phrase as required or once deleting single character because of clerical error as far as possible.Fig. 5 (a) shows the audio-visual picture according to the example of the whole phrase of deletion of the embodiment of the invention; Fig. 5 (b) shows the audio-visual picture according to the example of the single character of deletion of the embodiment of the invention.Shown in Fig. 5 (a), once write three characters " handwritten form " afterwards, the backspace key 118 in the candidate window is in
Form, can entirely delete this three characters by clicking it.Shown in Fig. 5 (b), after having carried out focus on selecting in the candidate hurdle, backspace key 118 is in ← form, its function is just only effective to the single character of choosing, and can delete the single character of being chosen so click it.Only illustrate in the form of the backspace key shown in this 118 with to its mode of operation (promptly clicking), obviously it can adopt other any suitable form and mode of operation.
In the above-described embodiments, handwriting input be Chinese character, writing axis is level, and presentation direction is from left to right and line feed downwards.But should be understood that these are example, but not limitation of the present invention.Handwriting input also can be the character or the symbol of English character or other form.Writing axis and presentation direction also can be other, for example vertically, from the top down or the like.And described a plurality of characters of writing also can be write respectively in a plurality of row.In fact, these variations only relate to the variation to the recognition method of the person's handwriting that is detected, and can not influence the enforcement to technical scheme of the present invention.In addition, the present invention also can support the monocase input method.
Fig. 6 is the process flow diagram according to the method that is used for handwriting input of the embodiment of the invention.At step S1, touching written character on the quick display screen.At step S2, detect at the person's handwriting that touches the character of being write on the quick display screen.At step S3, discern described character script.At step S4, as required, eject and consult window than the described little person's handwriting of quick display screen that touches at the described area that is touching on the quick display screen, wherein, described person's handwriting is consulted window and is presented scaled described Chinese character person's handwriting.Described person's handwriting is consulted window also can be write the space with increase by indentation.
The further embodiment according to the present invention, the segmentation result of correction/modification person's handwriting if desired, then this process proceeds to step S5, consults on the window at described person's handwriting described segmentation result is revised.Cutting apart of identifying the handwriting can be carried out in the process that character script is discerned, and also can carry out in response to needing to revise/revise the indication of person's handwriting.
So, in response to described correction, return step S3, upgrade identification according to the segmentation result of being revised to the character script of being write.
If do not need correction/modification person's handwriting segmentation result, can the step S6 candidate characters estimated, select the correct character that to import so from identifying.The further embodiment according to the present invention, identification step S3 can comprise when identification write to character script the time, estimate to accord with the corresponding candidate's list of phrases of person's handwriting with described multiword, and the corresponding candidate character list of any one character in any one the candidate's phrase in estimation and the described candidate's list of phrases.And, from described candidate's list of phrases, can directly select correct phrase (step S61), as the expection input character that accords with the whole phrase of person's handwriting corresponding to described multiword.Also can be from corresponding to selecting correct character (step S62) in the candidate character list of the single character selected candidate's phrase, as the expection input character of described single character.
In addition, the present invention can provide and the method corresponding apparatus, and described equipment is made up of various modules, and described module is provided for carrying out the function of described method.Module can partly be implemented as hardware, partly is embodied as software or the firmware (hardware and software combines) that can be carried out by the processor of for example controller, microprocessor or other computing equipment.The present invention can be used as computer program and is provided, and described product comprises specializes the computer-readable storage organization of this computer program code (just, software or firmware) to be used for being carried out by processor thereon.
Above-mentioned handwriting input scheme proposed by the invention as the hand-writing input method that strengthens, will be improved the availability of mobile phone.Above-mentioned and below content in, being input as example with Chinese character is described, but should understand, except Chinese character, the present invention also goes for the character of other type, the for example character (for example symbol) of the character of other Languages (for example English, Japanese, Korean or the like), other non-class of languages, or above-mentioned combination.Technology of the present invention in addition can be applied on the miscellaneous equipment of supporting the handwriting input user interface design, and for example this has the fixed telephone that touches quick display screen, computing machine, PDA(Personal Digital Assistant) etc.
Present invention resides in this explicitly or briefly disclosed any novel feature or these combination of features.Though, it will be understood by those skilled in the art that multiple change and the variation of existence to said system and technology about comprising that the specific example of carrying out preference pattern of the present invention described the present invention.Therefore, the spirit and scope of the present invention should be explained widely as the quilt of being set forth in the claims.