CN108228540A

CN108228540A - Utilize person's handwriting gesture editing handwriting input

Info

Publication number: CN108228540A
Application number: CN201611162351.8A
Authority: CN
Inventors: 陈宇聪; 杨晓飞; 刘小力; 侯辉华; 陈旭; 吴凡; 吴一凡; 暨慧芳; 丛艳吉; 何紫微
Original assignee: Microsoft Technology Licensing LLC
Current assignee: Microsoft Technology Licensing LLC
Priority date: 2016-12-15
Filing date: 2016-12-15
Publication date: 2018-06-29

Abstract

According to realization in the present disclosure, it is proposed that a kind of handwriting input scheme.In this scenario, person's handwriting gesture is provided for editing identified handwriting characters.Person's handwriting gesture can be detected via other handwriting input.In response to detecting such handwriting input, processing identified character is processed operations to based on corresponding with person's handwriting gesture, so as to obtain new character.New character is different from original identified character on stroke structure or stroke order.In this way, it is replaced in all complicated stroke of complete input character, relatively simple person's handwriting gesture may be used to edit identified character, so as to which the character transformation that will have simple stroke is character more complicated on stroke structure using as input, so as to fulfill faster handwriting input and handwriting recognition.In addition it is also possible to by adjusting the sequence of stroke come obtain from different characters, increase the flexibility of handwriting input.

Description

Utilize person's handwriting gesture editing handwriting input

Background technology

Handwriting input is the available a kind of input method of electronic equipment for having touch screen.For many users, especially It is using for the user of Asian language or Arabic language, handwriting input may be more convenient, because user can be according to book It writes custom to directly input, without by other phonetic notation modes (such as the phonetic in input in Chinese or the vacation in Japanese input Name).Handwriting input can be designed as an input options of input system.It, can be by when user selects handwriting input The tools such as writing pencil or even directly by finger in the handwriting input region of touch screen stroke writing.Input system detects Stroke input by user, and be the character under language-specific by the Stroke discrimination detected.In conventional hand-written input system In, the handwritten stroke of user is typically completely corresponding with the character identified.That is, when user want to input some or Certain characters, he/her should completely write out all strokes of character.

Invention content

According to realization in the present disclosure, it is proposed that a kind of handwriting input scheme.In this scenario, person's handwriting gesture (ink Gesture it) is provided for editing identified handwriting characters.Person's handwriting gesture can via other handwriting input and by It detects.If detecting such handwriting input, based on it is corresponding with person's handwriting gesture process operations to processing it is identified Character, so as to obtain new character.New character is different from original identified character on stroke structure or stroke order.It is logical This mode is crossed, all complicated stroke of complete input character is replaced in, relatively simple person's handwriting gesture may be used to edit Identified character is character more complicated on stroke structure using as defeated so as to have the character transformation of simple stroke Enter, so as to fulfill faster handwriting input and handwriting recognition.In addition it is also possible to by adjusting the sequence of stroke come obtain with not Same character, increases the flexibility of handwriting input.

It is the specific implementation below in order to which simplified form introduces the selection to concept to provide Summary It will be further described in mode.Summary is not intended to identify the key feature or main feature of claimed theme, Also it is not intended to limit the range of claimed theme.

Description of the drawings

Fig. 1 shows the block diagram for the computing environment that can implement multiple realizations in the present disclosure；

Fig. 2A and Fig. 2 B show the user interface for being used to provide handwriting input according to one in the present disclosure realization Schematic diagram；

Fig. 3 shows the flow chart of the process of editor's handwriting input according to one in the present disclosure realization；And

Fig. 4 to Fig. 7 shows the user with person's handwriting gesture editing handwriting input according to each realization in the present disclosure The schematic diagram at interface.

In these attached drawings, same or similar reference mark is used to represent same or similar element.

Specific embodiment

Present disclosure is discussed now with reference to several example implementations.It should be appreciated that discuss these realization be only for So that those of ordinary skill in the art better understood when and therefore realize present disclosure rather than imply to this theme Range any restrictions.

As it is used herein, term " comprising " and its variant will be read as meaning the opening " included but not limited to " Formula term.Term "based" will be read as " being based at least partially on ".Term " realization " and " a kind of realization " will be solved It reads as " at least one realization ".Term " another realization " will be read as " at least one other realization ".Term " first ", " second " etc. may refer to different or identical objects.Hereafter it is also possible that other specific and implicit definition.

Fig. 1 shows the block diagram for the computing device 100 that can implement multiple realizations in the present disclosure.It should be appreciated that Fig. 1 Shown computing device 100 is only exemplary, the function without that should form the described realization to present disclosure With any restrictions of range.As shown in Figure 1, the component of computing device 100 can include but is not limited to one or more processors Or processing unit 110, memory 120, storage device 130, one or more communication units 140, one or more input equipments 152 and one or more output equipment 154.

In some implementations, computing device 100 may be implemented as various user terminals, such as any type of movement eventually End, fixed terminal or portable terminal, including cell phone, website, unit, equipment, multimedia computer, multimedia tablet, Internet node, communicator, desktop computer, laptop computer, notebook computer, netbook computer, tablet calculate Machine, PCS Personal Communications System (PCS) equipment, personal navigation equipment, personal digital assistant (PDA), audio/video player, number Camera/camcorder, positioning device, television receiver, radio broadcast receiver, electronic book equipment, game station or its Meaning combination, accessory and peripheral hardware or its arbitrary combination including these equipment.It is also foreseeable that computing device 100 can Support any type of interface (" wearable " circuit etc.) for user.

Processing unit 110 can be reality or virtual processor and can according to the program stored in memory 120 come Perform various processing.In a multi-processor system, multiple processing unit for parallel execution computer executable instructions are calculated with improving The parallel processing capability of equipment 100.Computing device 100 generally includes multiple computer storage medias.Such medium can be It is the addressable any medium that can be obtained of computing device 100, including but not limited to volatile and non-volatile medium, detachable With non-dismountable medium.

Memory 120 can be volatile memory (such as register, cache, random access storage device (RAM)), Nonvolatile memory (for example, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or Its certain combination.Memory 120 can include one or more program products 122, have one or more program module collection It closes, these program modules are configured as performing the function of various realizations described herein.

Storage device 130 can be detachable or non-removable medium, and can include machine readable media, such as Memory, flash drive, disk or any other medium, it can be used to store information and/or data 132 (such as one or Multiple character maps) and can be accessed in computing device 100.It should be appreciated that above description is only exemplary, Data 162 can also be stored in other any appropriate form memories.In one example, data 162 can be in a distributed manner The mode of storage is stored in multiple storage devices.

Computing device 100 may further include other detachable/non-dismountable, volatile, nonvolatile storage and be situated between Matter.Although not shown in FIG. 1, it can provide and be driven for the disk for being read out or being written from detachable, non-volatile magnetic disk The dynamic and disc drives for being read out or being written from detachable, anonvolatile optical disk.In such cases, each driving can To be connected to bus (not shown) by one or more data media interfaces.

The realization of communication unit 140 is communicated by communication media with other computing device.Additionally, computing device The function of 100 component can realize that these computing machines can be by logical with single computing cluster or multiple computing machines Letter connection communicates.Therefore, computing device 100 can use and other one or more servers, NetPC Network PC (PC) or the logical connection of another general networking node is operated in networked environment.

Computing device 100 can also be set as desired by communication unit 140 and such as storage device (database), display Other standby etc one or more external equipment (not shown) communicate, with one or more so that user and computing device 100 interaction equipment communicate or with cause computing device 100 with one or more other computing device communications it is any Equipment (for example, network interface card, modem etc.) communicates.Such communication can be via input/output (I/O) interface (not Show) it performs.

Input equipment 152 can be one or more various input equipments, such as mouse, keyboard, trackball, phonetic entry Equipment etc..Output equipment 154 can be one or more output equipments, such as display, loud speaker, printer etc..At some In realization, input equipment 152 and output equipment 154 may be constructed individual interface 150, such as touch screen.Touch screen 150 can wrap Include various touch sensitive screens, touch display, touch tablet etc..

Touch screen 150 can show user interface.Computing device 100 can by the user interface on touch screen 150 to User shows content, and user can also move by finger or writing pencil etc. in touch screen 150 to manipulate user interface. During some are realized, user can be moved on touch screen 150 by writing pencil or directly by finger with to user interface Corresponding region input content.

Fig. 2A and Fig. 2 B illustrate for provide handwriting input user interface 200 example.In Fig. 2A and Fig. 2 B, use Family interface 200 is displayed on the touch screen 150 of computing device 100.User interface 200 includes handwriting input region 202 and text This input area 206.User can pass through the entering stroke in order of tool 220 in handwriting input region 202.Show in shown In example, tool 220 is the finger of user.User can also carry out entering stroke by other tools by writing pencil etc..In some realizations In, with the input of stroke, corresponding input is presented in handwriting input region 202.

In Fig. 2A and Fig. 2 B, the handwriting input 230 shown in handwriting input region 202 can include user's handwriting input Multiple strokes.By the identification of hand-written input system, one or more characters corresponding with handwriting input 230 can be input into In text input area 206.In the example of Fig. 2A and Fig. 2 B, text input area 206 is illustrated as the search of search application Frame.It should be appreciated that it is defeated to perform text to any any region for receiving text being presented in the user interface 200 Enter.

In the realization of Fig. 2A, user interface 200 further includes candidate display region 204, for showing from handwriting input 230 The candidate characters 240 of identification.By detecting selection of the user to candidate characters 240, candidate characters 240 can be input into text In input area 206.Although only showing a candidate, in other realizations, can also be provided in candidate display region 204 and hand Write other the relevant candidates of input 230.Alternatively, in the realization of Fig. 2 B, from the candidate characters 240 of the identification of handwriting input 230 It is displayed directly in handwriting input region 206.Therefore, handwriting input region 206 also serves as candidate display region.In this feelings In condition, shown candidate characters 240 can be identify with the most matched candidate of handwriting input 230.By selection (such as Touch) candidate characters 240 or selection user interface 200 on other function element, can realize and input candidate characters 240 Into hand-written input area 206.

In some implementations, the user interface 200 in Fig. 2A and Fig. 2 B can also include the control list for handwriting input Member, these control units are triggered by the predetermined interactive action of user's click etc, to allow to perform predefined function.Control is single The example of member includes deleting button, carriage return button, space button, exit button etc..Certainly, other control units are also possible And it is added in the user interface for handwriting input as needed.It should be appreciated that the use shown in Fig. 2A and Fig. 2 B Composition, layout in the user interface of handwriting input etc. can be designed that just for the sake of illustrating under different applications Different user interfaces are for handwriting input.

It, can not in other realizations although illustrating handwriting input using touch screen as example herein Handwriting input is detected as desired by the direct touch on detection touch screen, but hand can be moved in the air by detecting user Finger, arm, writing pencil or other tools and the handwriting input performed.In general, handwriting input can include touching hand-written defeated Enter and non-tactile handwriting input.One stroke of handwriting input also refers to the primary with beginning and end of user's execution Action.One or more stroke compositions may be constructed a character or gesture.

As mentioned above, it in traditional hand-written inputting method, has been needed to input some or certain characters, user Site preparation writes out all strokes of character so that hand-written input system identifies.Traditional hand-written inputting method at least exists following Defect.

First, accurate memory and writing of the handwriting input requirement user to character.In complexity of the writing with more stroke During character (such as Chinese character), user will be write and be also possible to be caused due to inaccurate memory time-consuming and laboriously Clerical error.If user needs to input multiple repeat character (RPT)s, also to expend the time writes out each character one by one, and it reduce defeated The speed entered.In addition, people increasingly tend to need text input in daily exchange, content retrieval, text entry etc. now Activity in use multilingual.However, this further requirement user can accurately remember and write out same under different language The character of meaning.Since the character under different language is usually far different, which in turns increases burden for users, reduce text The speed of input.

Secondly, have the character of complicated stroke that the identification for leading to system is difficult and increase recognition time.User is in book Possible interval is nearer between stroke when writing the character of complicated stroke, and the structure between stroke is caused to be difficult to clearly be distinguished, this will Can cause it is higher identification mistake or to spend more the time perform identification.It is more portable in particular with electronic equipment and Need the content presented more and more on screen, less and less for the zone user interface of handwriting input, this is further increased Identification difficulty, because user possibly can not clearly write multiple strokes of character in limited region.

In addition, in the case of user writes multiple characters, the identification of character follows strictly the sequence write in stroke. That is the character that stroke is first written will be identified that the first character in multiple characters, remaining character is also known in order Not.If the user desired that the sequence of multiple characters write of adjustment, then it is merely able to delete the character that currently inputs and then Re-write stroke corresponding with desired character sequence.Although sequence identification stringent in this way is conducive to character recognition, But to reducing the flexibility of handwriting input.

In order to solve above-mentioned and other potential problems at least partly, a kind of new handwriting input scheme is herein proposed. It is as briefly mentioned above, according to realization in the present disclosure, person's handwriting gesture is provided for editing handwriting input.By person's handwriting gesture, It is unnecessary to require user complete and accurately write out all strokes for the character for it is expected input, but can be by being based on person's handwriting hand The hand-written character of gesture processing, modification or adjustment it is expected the character of input to obtain.The use of person's handwriting gesture can reduce user The recognition accuracy of time and/or raising handwriting input needed for handwriting input.For example, it can allow user's input that there is stroke Simple character and change by person's handwriting gesture be the different complex characters of stroke structure.User can also allow for pass through Character under a certain linguistic form is translated to other different characters of stroke structure under another linguistic form by input person's handwriting gesture. Further, it is also possible to adjust the sequence of character using specific person's handwriting gesture, without requiring user's book in the correct order again Write characters.

Realization in the present disclosure is further described below by way of specific example.With reference first to Fig. 3, the figure shows roots According to the flow chart of the process 300 of editor's handwriting input of a realization of the disclosure.Process 300 can be implemented in computing device At 100.310, computing device 100 is based on handwriting input and (is known as " the first handwriting input ") identification character (being known as " first word Symbol ").First handwriting input can be detected via input interface, such as touch screen 150 of computing device 100.First is hand-written Input can include one or more strokes, these strokes are identified to form corresponding character.May be used it is a variety of Know or character identifying method leaved for development according to the hand-written stroke of user determines corresponding character.In some implementations, first Handwriting input can be displayed on the touch screen of computing device 100 with the writing of user or after user writes completion On 150.Depending on handwriting input, the character identified can be the character under any linguistic form.

According to the realization of the disclosure, person's handwriting gesture is provided for editing or handling the character in 310 identifications.320, meter It calculates equipment 100 and detects the handwriting input (being referred to as " the second handwriting input ") for including person's handwriting gesture.Second handwriting input can also It is made of one or more strokes.In some implementations, the person's handwriting gesture in the second handwriting input can be defined as including spy Fixed stroke and/or stroke structure.Alternatively or additionally, person's handwriting gesture may be at relative to the specific of the first handwriting input Position and/or the specific position in the handwriting input region 202 of user interface 200 in such as computing device 100.For it is expected Different disposal operation, different person's handwriting gestures can be defined.The stroke of person's handwriting gesture forms and between the stroke of character Relative position relation can be predefined or can be by user configuration or change.The several of gesture of identifying the handwriting specifically show Example will be described below.

Since the character and person's handwriting gesture of identification are related with the handwriting input of user, in some implementations, for receiving The handwriting input arrived, computing device 100 can decide whether comprising person's handwriting gesture.There may be various ways for detecting person's handwriting Gesture.Specifically, dwell interval between the type of stroke of the computing device 100 based on input, the position of stroke, stroke etc. Because whether usually distinguishing the second handwriting input comprising person's handwriting gesture.

In some implementations, if one or more strokes of the second handwriting input are with different from the stroke for forming character Stroke type, computing device 100 can determine the second handwriting input include person's handwriting gesture.Structure is used for usually under different language Stroke into character is limited, therefore can define some special strokes and be used as indicating different person's handwriting gestures.

Alternatively or additionally, computing device 100 can after the first handwriting input and the second handwriting input is received, Detect the relative positioning of the second handwriting input and the first handwriting input.One or more strokes of second handwriting input can be with One or more strokes of one handwriting input are associated, so as to indicate that the second handwriting input is person's handwriting gesture, available for editor from The character of first handwriting input identification.

In to realization of the entering stroke into edlin, computing device 100 is also based on the second handwriting input most Idle period without handwriting input determines whether the second handwriting input is person's handwriting gesture after the latter stroke.It is this is because logical Common family during written character, interval between stroke (such as the beginning of the end of preceding unicursal and next stroke it Between interval) be shorter because user wants constantly to input multiple characters.If it is desire to it is used to form to what is be previously entered Into edlin, whether the character editings to be viewed such as user may expect after person's handwriting gesture is performed succeed the stroke of character.Cause This, can set idle period threshold value.If the idle period after the last one stroke of the second handwriting input is more than the threshold Value, computing device 100 determine to detect person's handwriting gesture.

It is understood that computing device 100 can be between the type based on stroke, the position of stroke, stroke free time Whether one of period or more persons detect the second handwriting input comprising person's handwriting gesture.In addition computing device 100 can also be Or replace the input that person's handwriting gesture is determined by other factors.For example, can in the user interface of computing device 100 or Software or hardware button are provided on the writing pencil that user uses.It is inputted after the button is activated (such as being depressed by the user) Stroke can be detected as forming person's handwriting gesture.A variety of detection methods known or leaved for development may be used to distinguish character Stroke and person's handwriting gesture stroke, the scope of the present disclosure is not limited in this respect.

Although being shown in figure 3 with particular order, for writing out the first handwriting input of the first character and comprising pen Second handwriting input of mark gesture can perform in any order.For example, user can be allowed to write the first handwriting input first Stroke and then input include the second handwriting input of person's handwriting gesture.In another example, user can also be allowed first The second handwriting input for including person's handwriting gesture is write, and then writes the first handwriting input of the first character of instruction again.Certainly, The first character and person's handwriting gesture can be distinguished in computing device 100 not against the writing priority of stroke or the idle period of stroke In the case of, user can also be allowed alternately to write the stroke of the first handwriting input and the stroke of the second handwriting input.

Referring now still to Fig. 3,330, in response to detecting second handwriting input, by being based on person's handwriting gesture processing first Character obtains at least one second character.Second character is associated with the first handwriting input namely the second character can replace directly Connect the first character for recognizing and input as the first handwriting input is candidate for selection or directly as input results.According to The realization of the disclosure by person's handwriting gesture, can be handled the stroke structure and/or stroke order of the first character, so that The second character that must be obtained is different from the first character on stroke structure and/or stroke order.Different person's handwriting hands can be defined Gesture performs the first character different processing so that user specifies.The specific of some person's handwriting gestures is described referring to Fig. 4 to Fig. 7 Example.It should be appreciated that can also relate to other person's handwriting gestures for handle the first character with obtain different stroke structures and/or Second character of stroke order.

Fig. 4, which is shown in the user interface 400 on the touch screen 150 of computing device 100, uses person's handwriting gesture editing hand-written One example of input.The user interface 400 of Fig. 4 is similar with the user interface 200 of Fig. 2A, including handwriting input region 402, waits Select display area 404 and text input area 406.Handwriting input region 402 passes through finger or such as hand for receiving user Write the stroke of the tool input of pen etc.The candidate characters that candidate display region 404 is identified for display based on handwriting input. After receiving user's confirmation or selection candidate characters, which is input into text input area 406.It should be appreciated that it uses Family interface 400 is only an example.In other examples, user interface 400 can include other user interface object, difference User interface object or less user interface object.For example, in one example, user interface 400 can not include waiting Select display area 404.

Example shown in Fig. 4 is related to the person's handwriting gesture for being referred to as character combination gesture.Character combination gesture can be used for leading to The multiple examples for crossing the character (i.e. the first character) that combination has recognized generate single fresh character (i.e. the second character).Many words In character can be formed by multiple example combinations of another character, especially for example there is this kind of in such as Chinese character for this phenomenon Ideograph in.By the combination of character, the stroke structure of the second character is totally different from the stroke structure of the first character.

In the example of fig. 4, computing device 100 detects the hand-written entering stroke of user in handwriting input region 402 410, and therefrom identify the first chinese character " gold ".Computing device 100 also detects second in handwriting input region 402 Handwriting input 420 (can be before or after 410 detection) and determine the second handwriting input 420 include character combination hand Gesture.In this example, character combination gesture includes two specific strokes.It is specific by two that detect the second handwriting input 420 Idle period after the relative positioning and the last one stroke of the type of stroke, these strokes and the first handwriting input 410, Computing device 100 can determine that the second writing input 420 includes character combination gesture.

After character combination gesture is detected, the application of computing device 100 is corresponding with the gesture to be handled to handle first Chinese Word character " gold ".Specifically, three examples of the first chinese character " gold " can be combined to obtain single second chinese character " prosperous " 430.Second character " prosperous " can be displayed on candidate display region as the input candidate of the first handwriting input 410 In 404.In some implementations, character map corresponding with character combination gesture can be pre-set.The character map can To include the mapping relations between the first character and one or more second characters.If detecting character combination gesture, calculate Equipment 100 can access the character map, and the first character is mapped as at least one second character.Character map can To be stored locally in the storage device 130 of computing device 100 or can be via the communication unit 140 of computing device 100 It is accessed from External memory equipment.

In some implementations, the different numbers (such as 2,3,4 etc.) of the example of the first character of combination can be by Kinds of characters combines gesture to specify.For example, in the example of fig. 4, the stroke of the second handwriting input 420 includes digital " 3 ", The number for being used to indicate the example for the first character that it is expected combination is 3.It can also be by other numbers or indicated number purpose character The part of (such as " two ", " three ", " four ") as different character combination gestures.

In other realization, due to obtaining the possibility of another second character from multiple example combinations of the first character It is limited, therefore single character combination gesture can be used only, and will be from the institute of the different number of example of the first character It is possible that be determined as the second different characters for selection to be shown to user for combination.For example, it is assumed that know from the first handwriting input Other first character is " wood ", after character combination gesture is detected, the word that two example combinations of " wood " can be obtained It is second character to accord with " woods ", and can the character " gloomy " that three example combinations of " wood " obtain be determined as another second Character.

It should be appreciated that Fig. 4 only shows an example of character combination gesture.Can also pre-define or by user configuration its His stroke is as character combination gesture.By the use of character combination gesture, it can allow user that need not input complex characters Whole strokes, but only need to input the stroke of the character for the part for forming the complex characters and then by character combination hand Will definitely the character transformation be complex characters.In this way, it is possible to reduce the stroke of user's handwriting input accelerates handwriting input Speed.Moreover, because only needing the identification stroke of simple characters and person's handwriting gesture, the accurate of handwriting input identification can also be reduced It spends and improves recognition speed.

Fig. 5 A and Fig. 5 B show in the user interface 400 on the touch screen 150 of computing device 100 and are compiled with person's handwriting gesture Collect the other example of handwriting input.Fig. 5 A and Fig. 5 B are related to that the person's handwriting gesture that character replicates gesture can be referred to as.Character is answered Gesture processed can be used for obtaining a string of identical words by replicating the multiple examples of character (i.e. the first character) recognized It accords with (i.e. the second character).This is very effective in the case where user needs to repeatedly input some character.These second characters Set stroke structure is also different on the whole for the first character because they include more strokes.

Character, which replicates gesture, can act on single first character or multiple first characters.Fig. 5 A are shown to be answered using character The example that gesture processed handles single first character identified.In this example, computing device 100 is in handwriting input area The hand-written entering stroke 510 of user is detected in domain 402, and therefrom identifies single first chinese character " whole ".Computing device 100 also detected in handwriting input region 402 second handwriting input 520 (can be before or after 510 detection) and Determine that the second handwriting input 520 includes character and replicates gesture.Similar with the example of character combination gesture, character, which replicates gesture, also may be used To include specific stroke.By detecting the type of the stroke, stroke and the relative positioning and the stroke of the first handwriting input 520 Idle period without handwriting input later, computing device 100 can determine that the second handwriting input 520 includes character and replicates gesture.

After detecting that character replicates gesture, the application of computing device 100 is corresponding with the gesture to be handled to replicate first Chinese Multiple examples of word character " whole ", to generate a string of identical characters " whole " as the second character.Time replicated to the first character Number can be predetermined number (such as 2 times, 3 times, it is 4 inferior).It is alternatively possible to by making to the duplication of the different numbers of the first character For multiple second character sets, and it is candidate using these different character sets as input.It for example, can be by by first Chinese " whole " duplication of word character obtains two the second characters " whole " 530 twice, and can also be by by the first chinese character " whole " Duplication obtains three the second characters " whole whole " 532 three times.Second character 530 and 532 can be displayed on candidate display region In 404 for selection by the user.

In some cases, computing device 100 can identify two or more first words from the first handwriting input 510 Symbol.Detect act on multiple first characters character replicate gesture (such as character replicate gesture a stroke wrap completely Enclose these the first characters) in the case of, computing device 100 can also replicate these the first characters to obtain different the The respective symbols string of one character, these character strings can be used as multiple second characters.For handling the character of multiple first characters Replicating gesture can be identical or different with being used to handle the character duplication gesture of single first character.Multiple first characters are answered System can be there are many mode.For example, it is assumed that identify two characters " A " and " B " from the first handwriting input, it can be by the two words Symbol copies as four the second characters " AABB " or can also replicate two characters respectively as four the second characters in order “ABAB”.Alternatively, the second character that different copy modes obtains can be presented to the user as different input candidates.

Fig. 5 B show the example that multiple first characters of gesture processing are replicated with character.Computing device 100 is from handwriting input The first handwriting input 512 in region 402 identifies two the first characters " neat ", and also detects and replicate hand comprising character Second handwriting input 522 of gesture.Computing device 100 can differently replicate two the first characters " neat " recognized To obtain multiple second characters " in perfect order " 534 and multiple second characters " neat " 536.Second character 534 and 536 is It is displayed in candidate display region 404 for selection by the user.

In some implementations, character map corresponding with character duplication gesture can be pre-set.The character map It can include mapping relations between the first character and multiple second characters, such as the Chinese phonetic alphabet and simplified form of Chinese Character (or in traditional font Text) between mapping relations or simplified form of Chinese Character and Chinese-traditional between mapping relations.If detect that corresponding character is answered Gesture processed, computing device 100 can access corresponding character map, and the first character is mapped as multiple second characters. Character map can be stored locally in the storage device 130 of computing device 100 or can be via computing device 100 Communication unit 140 is accessed from External memory equipment.In other realization, directly the first character recognized can also be answered System repeatedly obtains multiple second characters, without searching character map.

It should be appreciated that Fig. 5 A and Fig. 5 B only show that character replicates the example of gesture.It can also pre-define or be matched by user It puts other strokes and replicates gesture as character.The use of gesture is replicated by character, can allow user that need not input multiple words Whole strokes of symbol, but only need the stroke of one in multiple characters or some characters and gesture is then replicated by character It is the desired multiple characters of user by the character transformation of input.In this way, it is possible to reduce the stroke of user's handwriting input, Accelerate the speed of handwriting input.Moreover, because only needing to identify less character, the accuracy of handwriting input identification can also be reduced simultaneously Improve recognition speed.

In some cases, user may wish to input the character under a certain linguistic form, but can not correctly write The stroke writing of the stroke of the character or the character is excessively complicated.For example, in the language of input is performed with phonetic notation mode, use Family may be familiar with the phonetic notation of some character but can not correctly write out all strokes of the character.In other examples, The character of same meaning stroke structure and complexity under different language form differ greatly, in order to accelerate hand-written speed and raising Recognition accuracy, it will be more favorable to input better simply character and perform conversion by computing device 100.Therefore, in some realities In existing, the translation between linguistic form can be performed by specific person's handwriting gesture.Such person's handwriting gesture can be referred to as Language translates gesture.The first character under first language form can be translated to it in second language by language translation gesture Corresponding second character under situation.For the translation between different linguistic forms, different language translation gestures can be related to.

Fig. 6 A and Fig. 6 B show the example of two language translation gestures.In the example of Fig. 6 A, computing device 100 is in hand It writes and the hand-written entering stroke 610 of user is detected in input area 402, and therefrom identify the first character " xin ".Computing device 100 also detected in handwriting input region 402 second handwriting input 620 (can be before or after 610 detection) and Determine that the second handwriting input 620 includes language and translates gesture.Language translation gesture can include two different specific strokes.It is logical Cross the sky after the type for detecting these strokes, their relative positionings and the last one stroke with the first handwriting input 620 Idle section, computing device 100 can determine that the second handwriting input 620 includes language and translates gesture.

Type and positioning by stroke, computing device 100 can also determine language translation gesture instruction by the first character Translate to the Chinese character under simplified form of Chinese Character form.During the first character is handled, computing device 100 identifies the language of the first character Speech form is the PINYIN form of Chinese, and translates gesture based on the language, and the first character " xin " of PINYIN form is translated to Its character " prosperous " under simplified form of Chinese Character form is using as the second character 630.Second character 630 is displayed on candidate display region In 404.

Fig. 6 B show another language translation gesture.In this example, computing device 100 is in handwriting input region 402 It detects the hand-written entering stroke 612 of user, and therefrom identifies the first character " dragon ".Computing device 100 is also in handwriting input The second handwriting input 622 (can be before or after 612 detection) and similar with the example of Fig. 6 A is detected in region 402 Ground determines that the second handwriting input 622 includes language and translates gesture.The character of simplified form of Chinese Character is translated in language translation gesture instruction Character for Chinese-traditional.Based on gesture is translated to language, computing device 100 translates to the first character " dragon " of simplified form of Chinese Character Its character " Long " under Chinese-traditional form is using as the second character 632.Second character 632 is displayed on candidate display region In 404.

Computing device 100 can use various language translation tool that the character under a kind of linguistic form is translated to another kind Character under linguistic form.In other realization, character map corresponding with language translation gesture can be pre-set. The character map can include the mapping relations between the first character and multiple second characters.If detect that language translates hand Gesture, computing device 100 can access the character map, and the first character is mapped as multiple second characters.Character maps Table can be stored locally in the storage device 130 of computing device 100 or can be via the communication unit of computing device 100 140 access from External memory equipment.In other realization, directly the first character recognized can also be replicated repeatedly to come Multiple second characters are obtained, without searching character map.

It should be appreciated that Fig. 6 A and Fig. 6 B only show the example of language translation gesture.It can also pre-define or be matched by user It puts other strokes and translates gesture as language.The use of gesture is translated by language, can allow user can without handwriting input The stroke of character under a certain linguistic form that can not can accurately remember, but familiar or simple character can be inputted first simultaneously And gesture is translated by language, the character of input is translated into other desired characters of user.This mode can improve user hand The flexibility ratio and speed of input are write, and by avoiding input complex characters, the accuracy of handwriting input identification can also be increased.

In some implementations, the first character or second linguistic form can be any language or language used Citation form.The example of such linguistic form can include but is not limited to：It is the roman character expression of Chinese, simplified form of Chinese Character, numerous Body Chinese, English, Russian, Hiragana, Japanese katakana, Korean, Arabic, German, Spanish, Portuguese, French or any other word used in every country or area.Particularly, Chinese roman character expression can wrap It includes the various roman characters for being used to carry out Chinese character phonetic notation and represents that example includes but not limited to：The Chinese phonetic alphabet, five input rule Then, Gwoyeu Romatzyh spellings, Latinxua Sin Wenz spellings, Cantonese romanization, Sidney Lau spellings Method, S.L.Wong romanizations, standard Cantonese phonetic, standard Roman phonetic, Shanghai native language Latin type phonetic method, Hainan words phonetic side Case,Romanization (or fuzhou dialect Roman capitals), Hakka phonetic plan, Phak-fa-su and Phagspa writings Symbol and other the Chinese Roman phonetics used in country.

Fig. 7, which is shown in the user interface 400 on the touch screen 150 of computing device 100, uses person's handwriting gesture editing hand-written Another example of input.Example shown in Fig. 7 is related to being referred to as the person's handwriting gesture that sequence adjusts gesture.Sequence adjustment gesture can The second character with different stroke orders is obtained for adjusting the sequence of the stroke of identified first character.Sequence is adjusted Whole gesture can adjust the relative position relation between multiple strokes of single first character with obtain the second different characters or Person can adjust the relative position relation between multiple first characters to obtain the second different characters.Specific stroke or character Adjustment can be determined based on the relative positioning of the second handwriting input and the first handwriting input.

In the example in figure 7, computing device 100 detects the hand-written entering stroke of user in handwriting input region 402 710, and therefrom identify multiple first chinese characters " numerous mountains and rivers ".Computing device 100 is also in handwriting input region 402 It detects the second handwriting input 720 (can be before or after 710 detection) and determines the second handwriting input 720 comprising suitable Sequence adjusts gesture.Computing device 720 is relatively fixed based on the second handwriting input 720 and multiple strokes of the first handwriting input 710 These multiple strokes are divided into multiple stroke sets 712 and 714 by position.For example, computing device 720 detects the second handwriting input First handwriting input 710 is divided into two parts, and then by the first handwriting input 710 in the two parts by 720 Stroke is divided into different stroke sets 712 and 714.

Gesture is adjusted based on sequence, computing device 100 exchanges the sequence of two stroke sets 712 and 714, and based on place The stroke of first handwriting input 710 of the position after adjustment, identifies the second character " long and arduous journey " 730.Computing device 100 The second character is re-recognized in stroke after being adjusted from position.Alternatively, computing device 100 can also be based in adjustment The stroke and stroke of position afterwards and the mapping relations of the first character adjust the sequence of the first character, and then will be in and adjust First character of the position after whole is as the second character.

Although it should be appreciated that show to multiple first character execution positions adjust, other realization in, can also be right The different strokes of single first character are adjusted, and then obtain new the second character of one or more.It is also understood that The stroke of single or multiple first characters can also be divided into the stroke set of three or more by sequence adjustment gesture, and so The relative position relation of these stroke set is adjusted according to different sequence adjustment gestures to obtain new character or character set afterwards.

Fig. 7 only shows that sequence adjusts an example of gesture, can also pre-define or other strokes are made by user configuration Gesture is adjusted for sequence.The use of gesture is adjusted by sequence, goes for that there is the pen different from having inputted character in user In the case of the character of picture sequence, the character that deletion has inputted may not need and again according to correct sequence stroke writing, and It can be based on sequence and adjust gesture to obtain desired character.This mode can reduce the stroke of user's handwriting input and Accelerate the speed of handwriting input.

The various person's handwriting gestures for editing handwriting input are described above.It should be appreciated that can also pre-set or Other person's handwriting gestures are defined by the user for changing, adjusting and/or editing the stroke that has inputted to obtain desired character in person. In implementation above, in the candidate display region 404 of user interface 400 display by obtain after person's handwriting gesture editing second Character is as candidate characters.In other realizations, candidate display region 404 can also show true for example, by various association's algorithms Fixed more candidate characters are for selection by the user.

In some implementations, it can provide for by the candidate display region 404 of the user interface 400 shown in Fig. 4 to Fig. 7 In candidate characters (including the second character) on the upper screen gesture shielded.It in general, can be by clicking the phase shown on screen Answer candidate characters that will shield on the character.Alternatively or additionally, it is similar with person's handwriting gesture, the pen by handwriting input can also be provided Draw the upper screen gesture of composition.Such upper screen gesture can be configured as or be defined by the user for comprising specific one or it is more A stroke is for identification.Shield the stroke that gesture can include each Roman number in a kind of example, be used to indicate selection respective counts The corresponding candidate characters of word.For example, in the example of Fig. 5 B, if character corresponding with digital " 1 " is detected, by the second word It accords on " in perfect order " in screen to text input area 406.

It should be appreciated that the upper screen gesture comprising other handwritten strokes can also be defined.In the candidate word for example shown in Fig. 2 B In the case of symbol is displayed on text input area 406, specific upper screen gesture can also be used (such as to include stroke " √ " Gesture) confirm the candidate characters to the input in the region.Scope of the present disclosure be not limited in this respect.

Function described herein can be performed by one or more hardware logic components at least partly.Example Such as, without limitation, the hardware logic component for the exemplary type that can be used includes：It is field programmable gate array (FPGA), special Integrated circuit (ASIC), Application Specific Standard Product (ASSP), the system (SOC) of system on chip, load programmable logic device (CPLD) etc..

Any group of one or more programming languages may be used in program code for implementing method in the present disclosure It closes to write.These program codes can be supplied to all-purpose computer, special purpose computer or other programmable data processing units Processor or controller so that program code when by processor or controller execution when make to be advised in flow chart and/or block diagram Fixed function/operation is carried out.Program code can be performed completely on machine, partly be performed on machine, as independence Software package partly performs on machine and partly performs or held on remote machine or server completely on the remote machine Row.

In context in the present disclosure, machine readable media can be tangible medium, can include or store The program for using or being used in combination with instruction execution system, device or equipment for instruction execution system, device or equipment.Machine Device readable medium can be machine-readable signal medium or machine-readable storage medium.Machine readable media can include but unlimited In times of electronics, magnetic, optical, electromagnetism, infrared or semiconductor system, device or equipment or the above What appropriate combination.The more specific example of machine readable storage medium can include being electrically connected, is portable based on one or more lines Formula computer disks, hard disk, random access memory (RAM), read-only memory (ROM), Erasable Programmable Read Only Memory EPROM (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage are set Standby or the above any appropriate combination.

Although in addition, depicting each operation using certain order, this should be understood to requirement operation in this way with shown The certain order that goes out performs or requires the operation of all diagrams should be performed to obtain desired result in sequential order. Under certain environment, it may be advantageous for multitask and parallel processing.Similarly, although containing several tools in being discussed above Body realize details, but these be not construed as to scope of the present disclosure limitation.Above and below individually realizing Certain features of described in the text can also be in combination realized in single realization.On the contrary, it is retouched in the context of single realization The various features stated can also individually or be in any suitable subcombination realized in multiple realizations.

It is listed below some sample implementations in the present disclosure.

On the one hand, this disclosure provides a kind of the method implemented by computer.This method includes：It is hand-written based on first Input the first character of identification；Detection includes the second handwriting input of person's handwriting gesture；And in response to detecting the second handwriting input, The first character, which is handled, by being based on person's handwriting gesture obtains at least one second character, at least one second character and first hand-written Input is associated with and is different from the first character on stroke structure and/or stroke order.

In some implementations, person's handwriting gesture includes character combination gesture.At least one second character is obtained to include：Based on word Symbol combination gesture, single character is generated by combining multiple examples of the first character.

In some implementations, person's handwriting gesture includes character duplication gesture.At least one second character is obtained to include：Replicate the Multiple examples of one character are to obtain a string of identical characters.

In some implementations, person's handwriting gesture includes language translation gesture.At least one second character is obtained to include：Determine table Show the first language form of the first character；And gesture is translated based on language, by the way that the first character is turned from first language form Second language form is translated into obtain at least one second character, second language form is different from first language form.

In some implementations, at least one of first language form and second language form, which are selected from, includes following item Group：Roman character expression, simplified form of Chinese Character, Chinese-traditional, Hiragana, Japanese katakana and the Korean of Chinese.

In some implementations, at least one second character is obtained to include：Obtain character map corresponding with person's handwriting gesture； And the first character is mapped as by least one second character based on character map.

In some implementations, person's handwriting gesture includes sequence adjustment gesture and the first handwriting input includes multiple strokes.It obtains At least one second character is obtained to include：Relative positioning based on the second handwriting input Yu multiple strokes of the first handwriting input, will Multiple strokes are divided into multiple stroke sets；Gesture is adjusted based on sequence, adjusts the relative position relation of multiple stroke sets；And base Multiple strokes in the position after adjustment generate at least one second character.

In some implementations, second handwriting input of the detection comprising person's handwriting gesture is included based at least one of following detection packet Second handwriting input of the gesture containing person's handwriting：The type for the stroke that second handwriting input includes；Second handwriting input and first hand-written The relative positioning of input；And second handwriting input the last one stroke after the idle period without handwriting input.

On the other hand, this disclosure provides a kind of equipment.The equipment includes：Display unit；Manage unit；And it deposits Reservoir coupled to processing unit and is stored with instruction, instructs and following act is performed when being performed by processing unit：Based on first Handwriting input identifies the first character；Detection includes the second handwriting input of person's handwriting gesture；And in response to detecting that second is hand-written Input handles the first character by being based on person's handwriting gesture and obtains at least one second character, at least one second character and the One handwriting input is associated with and is different from the first character on stroke structure and/or stroke order.

It yet still another aspect, this disclosure provides a kind of computer program product, computer program product is by visibly It is stored in non-transitory, computer storage medium and including machine-executable instruction, machine-executable instruction is performed by equipment When make equipment：First character is identified based on the first handwriting input；Detection includes the second handwriting input of person's handwriting gesture；And response In detecting the second handwriting input, at least one second character is obtained by being based on person's handwriting gesture the first character of processing, at least One the second character is associated with the first handwriting input and is different from the first character on stroke structure and/or stroke order.

In some implementations, person's handwriting gesture includes character combination gesture.Machine-executable instruction makes when being performed by equipment Equipment：Based on character combination gesture, single character is generated by combining multiple examples of the first character.

In some implementations, person's handwriting gesture includes character duplication gesture.Machine-executable instruction makes when being performed by equipment Equipment：Multiple examples of the first character are replicated to obtain a string of identical characters.

In some implementations, person's handwriting gesture includes language translation gesture.Machine-executable instruction makes when being performed by equipment Equipment：Determine the first language form of the first character of expression；And gesture is translated based on language, by by the first character from first Linguistic form translates to second language form to obtain at least one second character, and second language form is different from first language shape Formula.

It, should although having used specific to this theme of the language description of structure feature and/or method logical action When understanding that the theme defined in the appended claims is not necessarily limited to special characteristic described above or action.On on the contrary, The described special characteristic in face and action are only to realize the exemplary forms of claims.

Claims

1. a kind of the method implemented by computer, including：

First character is identified based on the first handwriting input；

Detection includes the second handwriting input of person's handwriting gesture；And

In response to detecting second handwriting input, by be based on the person's handwriting gesture handle first character obtain to Few second character, at least one second character be associated with first handwriting input and in stroke structure and/or It is different from first character on stroke order.

2. according to the method described in claim 1, wherein described person's handwriting gesture include character combination gesture, and wherein obtain to Few second character includes：

Based on the character combination gesture, single character is generated by combining multiple examples of first character.

3. according to the method described in claim 1, wherein described person's handwriting gesture include character replicate gesture, and wherein obtain to Few second character includes：

Multiple examples of first character are replicated to obtain a string of identical characters.

4. according to the method described in claim 1, wherein described person's handwriting gesture include language translate gesture, and wherein obtain to Few second character includes：

Determine the first language form of expression first character；And

Gesture is translated based on the language, by the way that first character is translated to second language shape from the first language form Formula obtains at least one second character, and the second language form is different from the first language form.

5. according to the method described in claim 4, in wherein described first language form and the second language form at least One selected from the group for including following item：The roman character expression of Chinese, simplified form of Chinese Character, Chinese-traditional, Hiragana, Japanese piece Assumed name and Korean.

6. include according to the method described in claim 1, wherein obtaining at least one second character：

Obtain character map corresponding with the person's handwriting gesture；And

First character is mapped as by least one second character based on the character map.

7. according to the method described in claim 1, wherein described person's handwriting gesture includes sequence adjustment gesture and described first-hand It writes input and includes multiple strokes, and wherein obtain at least one second character and include：

Relative positioning based on second handwriting input Yu the multiple stroke of first handwriting input, will be the multiple Stroke is divided into multiple stroke sets；

Gesture is adjusted based on the sequence, adjusts the relative position relation of the multiple stroke set；And

The multiple stroke based on the position after adjustment generates at least one second character.

8. according to the method described in claim 1, wherein second handwriting input of the detection comprising person's handwriting gesture is included based on following At least one detection includes the second handwriting input of person's handwriting gesture：

The type of stroke that second handwriting input includes；

The relative positioning of second handwriting input and first handwriting input；And

Idle period without handwriting input after the last one stroke of second handwriting input.

9. a kind of equipment, including：

Display unit；

Processing unit；And

Memory coupled to the processing unit and is stored with instruction, and described instruction is held when being performed by the processing unit Row is following to be acted：

First character is identified based on the first handwriting input；

10. equipment according to claim 9 wherein the person's handwriting gesture includes character combination gesture, and wherein obtains At least one second character includes：

11. equipment according to claim 9, wherein the person's handwriting gesture, which includes character, replicates gesture, and wherein obtain At least one second character includes：

12. equipment according to claim 9, wherein the person's handwriting gesture, which includes language, translates gesture, and wherein obtain At least one second character includes：

Determine the first language form of expression first character；And

13. equipment according to claim 12, wherein in the first language form and the second language form extremely Few one selected from the group for including following item：The roman character expression of Chinese, simplified form of Chinese Character, Chinese-traditional, Hiragana, Japanese Katakana and Korean.

14. equipment according to claim 9 includes wherein obtaining at least one second character：

Obtain character map corresponding with the person's handwriting gesture；And

15. equipment according to claim 9, wherein the person's handwriting gesture includes sequence adjustment gesture and described first-hand It writes input and includes multiple strokes, and wherein obtain at least one second character and include：

16. equipment according to claim 9, wherein second handwriting input of the detection comprising person's handwriting gesture is included based on following At least one detection includes the second handwriting input of person's handwriting gesture：

The type of stroke that second handwriting input includes；

17. a kind of computer program product, the computer program product is tangibly stored in non-transient computer storage and is situated between In matter and including machine-executable instruction, the machine-executable instruction makes the equipment when being performed by equipment：

First character is identified based on the first handwriting input；

18. computer program product according to claim 17, wherein the person's handwriting gesture includes character combination gesture, and And the machine-executable instruction makes the equipment when being performed by the equipment：

19. computer program product according to claim 17, wherein the person's handwriting gesture, which includes character, replicates gesture, and And the machine-executable instruction makes the equipment when being performed by the equipment：

20. computer program product according to claim 17, wherein the person's handwriting gesture, which includes language, translates gesture, and And the machine-executable instruction makes the equipment when being performed by the equipment：

Determine the first language form of expression first character；And