CN102460362B - Glyph entry on computing device - Google Patents

Glyph entry on computing device Download PDF

Info

Publication number
CN102460362B
CN102460362B CN201080024993.6A CN201080024993A CN102460362B CN 102460362 B CN102460362 B CN 102460362B CN 201080024993 A CN201080024993 A CN 201080024993A CN 102460362 B CN102460362 B CN 102460362B
Authority
CN
China
Prior art keywords
input
user
font
drafting
list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201080024993.6A
Other languages
Chinese (zh)
Other versions
CN102460362A (en
Inventor
栗阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of CN102460362A publication Critical patent/CN102460362A/en
Application granted granted Critical
Publication of CN102460362B publication Critical patent/CN102460362B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Abstract

A computer-implemented user interface method is disclosed. The method includes displaying on a touchscreen of a computing device a first sub-portion of a list of items, receiving from a user of the device an drawn input on the touchscreen, correlating the drawn input to an alphanumeric character, and automatically dispaying a second sub-portion of the list having one or more entries whose first character correlates to the alphanumeric character.

Description

Character pattern input on the computing device
The cross reference of related application
This application claims Application U.S. Serial No No.12/422 that submit on April 10th, 2009, that be entitled as " GLYPH ENTRY ONCOMPUTING DEVICE (character pattern input on the computing device) ", the right of priority of 185, is incorporated to its disclosure by reference at this.
Technical field
This document relates to for following system and technology: with the user interactions inputting the font of such as alphabetic character or the symbol of drafting in the display of computing equipment.
Background technology
People spend a few hours and their electronic equipment at every turn---together with computing machine, phone, music player etc.They like best and use directly perceived and it meets those equipment of the expectation how they should work about machine alternately most.They by from the input and output of equipment and electronic equipment mutual, wherein export and usually provide audibly and/or on planar graph display screen, and input can occur to keyboard and other such input mechanisms via touch-screen, operating rod, mouse, 4.
Along with mobile device becomes more powerful, the Drawing Object of the more uses of user such as project (item) list, map, image etc. comes with them mutual.Information represented by such object can be huge with regard to represented data, and visually very large (the detailed map of the U.S. will be several miles wide), and display is on the mobile apparatus very little.As a result, in sufficient detail for user provides graphical information (such as, by amplifying on a region of object), and still give user's space sense, and allow user can be a challenge in the movement intuitively of whole space.
Summary of the invention
This document describes and may be used for and the system of the user interactions of computing equipment and technology, described computing equipment is as the mobile phone with touch-screen user interface.Generally speaking, described technology by user being moved to the object be associated with font be stored in system of computational devices, can be reacted to user's input of the font in display.Font is that user can such as by usually in the single description action of finger of not lifting them, and what the finger dragging them on the touchscreen inputted visually writes element.Font can comprise alphanumeric character and other symbols.
Such as, just check that the user of the bulleted list of the length of the list of songs in such as playlist can draw alphabetic(al) letter and be automatically scrolling to make list the entry started with this letter in display.In a similar manner, a user part for map amplified can describe letter with pan to the nearest terrestrial reference started with this letter on the screen of its equipment.Or check that the user of virtual view in street can describe letter " E " and make its incarnation towards east on screen.
User can also be allowed one or more self-defined font to be distributed to special object in computer system.Such as, user can open the contacts entries for friend, and can select the control for submitting font to.Then user can describe any font (such as, the first letter or simple shape of the pet name of this friend) of his or she preference with the contact person record making this font be assigned to this friend.If user inputs this font when the equipment of use after a while, then user will directly be taken to this contact person record.Same target can also be distributed in multiple font, make user have various ways to arrive such object.
Multiple object can also be distributed in single font.Under these circumstances, when user inputs font, eject control and can list multiple object, and user can select one in them.As an alternative, appropriate object can be selected automatically by the linguistic context of system based on input font.Such as, if font is transfused to when address book application is movable, then equipment will jump to the contacts entries corresponding with font, instead of the music playlist corresponding with font.When linguistic context may relate to multiple object (such as, if input font on the table), can according to most probable by select object (such as, due to its often by the user of equipment access or be usually the object of a type of the accessed object more than another kind of type due to it) to object discrimination priority.
In some embodiments, such system and technology can provide one or more advantage.Such as, the user of computing equipment can carry out rapid navigation by this list by its letter drawn on the touchscreen jumped in list.Similarly, user by inputting the letter for object on screen and above the figure that object is positioned at describes, can navigate to the object in the two or three dimensions space be unsuitable on single screen.In addition, user can customize its computing equipment according to the needs of himself, and can by drawing self-defined font to jump to and the object in the current completely dissimilar application represented in display.In such ways, can Consumer's Experience be improved, and user can be made more effective when it uses equipment.
In one embodiment, a kind of computer implemented method for user interface is disclosed.First subdivision of display items display list on the touch-screen that the method is included in computing equipment, receive from the user of equipment drafting on the touchscreen input, make the input of drafting with alphanumeric character is interrelated and second subdivision with one or more entry of automatic display list, the first character and this alphanumeric character of described one or more entry are interrelated.The method can also comprise to be distinguished the rolling input of list and the input of alphanumeric character.The input identification bounding box of the part for alphanumeric character can be comprised to the differentiation of the input of roll input and alphanumeric character.Further, the input of drafting is received on the subdivision that the input of the drafting received on touch-screen can be included in bulleted list.
In certain aspects, bulleted list comprises bulleted list alphabetically, and the first entry alphabetically that the top place display that is included in the viewing area that list shows wherein of the second subdivision of display list starts with the first character.Further, if the method can comprise the input of drawing be not recognized as alphanumeric character, then the visual fail indicator maybe can listened is provided to user.Fail indicator can comprise and show the input of drawing to form with the color previously showing the input of drawing the color contrasted.In addition, the input of drafting can be defined by following: contact with the indicator of touch-screen and the indicator from touch-screen subsequently discharges, and the indicator path between indicator contact with indicator release described on the touchscreen.The method can also comprise: before the first subdivision of display items display list, receive the description to font touch-screen from user, determine that received font is corresponding to bulleted list and in response to reception font, the first subdivision of display items display list.
In another embodiment, disclose a kind of computer implemented method for user interface, it comprises: in the touch screen display of computing equipment from operating system or the content of application that operates on equipment; Receive the input of the drafting on the touchscreen above the content from operating system or application from the user of equipment, the input of wherein drawing is unconnected with the content from operating system or application; Identify and the user-defined font that the input of drawing is associated; And in response to the user-defined font of identification, the one or more user-defined interface element that display is corresponding with user-defined font automatically on the touchscreen.Show one or more user-defined interface element and can comprise the application starting and be associated with user-defined font.The method can also comprise one that identifies the multiple result corresponding with user-defined font and ask user to select in multiple result, the one or more user-defined interface element of result generation selected in it.
In another embodiment, disclose the article comprising program code stored computer-readable data storage medium, described program code being operative impels one or more machine performing operations.Operation comprises: the first subdivision of display items display list on the touch-screen of computing equipment, receive from the user of equipment drafting on the touchscreen input, make the input of drafting with alphanumeric character is interrelated and second subdivision with one or more entry of automatic display list, the first character and this alphanumeric character of described one or more entry are interrelated.Operation may further include to be distinguished the rolling input of list and the input of alphanumeric character.Further, bulleted list can comprise bulleted list alphabetically, and the first entry alphabetically that the top place display that is included in the viewing area that list shows wherein of the second subdivision of display list starts with the first character.The input of drawing can also be defined by following: contact with the indicator of touch-screen and the indicator from touch-screen subsequently discharge, and describe on the touchscreen contact the indicator path between discharging with indicator at indicator.
In certain aspects, operation comprises further: before the first subdivision of display items display list, receiving the description to font touch-screen from user, determining that received font is corresponding to bulleted list and in response to receiving font, the first subdivision of display items display list.
In another embodiment, disclose a kind of computer implemented user interface system, it comprises: figure shows, and it is used for representing the part that the object specified by alphanumeric title is shown of graphic user interface; Font interpreter, its user be used in the display of reception figure describes and identifies to describe corresponding font with received user; And the user's input control device drawn, it is programmed to display in figure display and had previously been identified as the new content corresponding with identified font.Object specified by alphanumeric title can be the part of the list object of sequence, and new content can comprise the one or more entries started with the character mating the font identified in list.Further, user's input control device of drafting can be programmed to distinguish input of rolling and draw input with user, and only when input be confirmed as be user draw input time just recognition font.It can also be programmed to the font receiving drafting from user, and is formed between the object impelling the interrelated font in drafting and user to identify, the object that the font that future customer input is drawn impels user to identify is by system address.It can be programmed to be identified in figure display further, when there is no visible input area, and the input of the drafting received above the application of activity.
In another embodiment, a kind of computer implemented user interface system comprises: figure shows, and it is used for representing the part that the object specified by alphanumeric title is shown of graphic user interface; Font interpreter, its user be used in the display of reception figure describes and identifies to describe corresponding font with received user; And device, it is used for receiving font, one in display object in response in figure display, and wherein shown object is interrelated with the font identified.
One or more embodiments of the detail are set forth in the the accompanying drawings and the following description.Other Characteristics and advantages are from description and accompanying drawing and will be apparent from claims.
Accompanying drawing explanation
Fig. 1 illustrates a series of screenshotss being rolled to the position corresponding with the character that user inputs in list of mobile touch screen apparatus.
Fig. 2 illustrates a series of screenshotss of programming with self-defined font of mobile touch screen apparatus.
Fig. 3 illustrates a series of screenshotss that the multiple fonts corresponding with object are shown of mobile touch screen apparatus.
Fig. 4 is in response to touch-screen input and provides the schematic diagram of the system of user interactions.
Fig. 5 A-5D is the process flow diagram of the instantiation procedure of character pattern input for the treatment of the user via computing equipment.
Fig. 6 A-6B is the process flow diagram for the instantiation procedure be associated with some calculating object by font.
Fig. 7 illustrates and may be used for realizing the computer equipment of technology described here and the example of mobile computer device.
Reference symbol identical in each accompanying drawing indicates identical element.
Embodiment
This document describes by its mobile device can with the system of the user interactions of such equipment and technology.Like this alternately can by mobile device in many cases can with Rome/Latin character style, user's input of simple characters or font responds and produces.Such as, user can by describing letter on a display screen above shown playlist, make to show the first entry started by the character inputted with user jumped in list, jump to the position in the list of alphabetically sorting of such as music playlist.
In addition, user can be allowed operating system to be distributed in his or she font or runs on the various different object in the application in operating system.Such as, user can navigate to object, the media file of such as contact person, song, another kind of type or other similar objects.User can select the control be associated with this object to point out font to distribute to the intention of this object, and font is drawn in the display that then may be indicated on computing equipment.Font can occur as they draw it, to enable them to confirm the font (or they can select to repaint font) that they want them to draw to distribute.When user uses equipment after a while, they can draw the font that they have created, to jump to this object.In some cases, font can be drawn any position on equipment, and can for object by discrimination, and in other cases, font can only when equipment is in a certain linguistic context just by discrimination (font such as, for the position in application-specific can only be only available when this application is movable).
Fig. 1 illustrates a series of screenshotss being rolled to the position corresponding with the character that user inputs in list of mobile touch screen apparatus.Generally speaking, screenshotss are the screenshotss inputting the display of the mobile computing device of the form of various alphabetical font with intelligent movable mobile phone and user on the touch-screen of equipment.Each difference shown during user input sequence in six screenshotss shows.
The display of letter specified by (a) shows user and checks contacts list on its equipment.Contacts list alphabetically sorts, and at the beginning of action, is set in the name that is parked in and starts with letter " C ".As can be seen, user just describes in the process of lowercase " b " on screen, and this character along with user describe showing upper imitated.In display place specified by letter (b), user has completed the description to letter, and can see that list of names jumps to the name started with the letter " B " corresponding with the letter that user describes automatically, wherein the B name of the first alphabetic order is at list top.Therefore, the equipment expression of font coupling " b " alphabetically described of identification user, and impel this position showing and to jump in list.
In display place specified by letter (c), user has determined that it is intended to check the entry started with letter " C ", and therefore they start to describe this letter on the screen of the device.As being illustrated, showing along with their input and repeat their input, and display place pointed by letter (d), letter " C " lifts its finger along with user from touch screen surface and completes.At this point, equipment determines that the input of user completes, and by main circular but the input of opening is interpreted as letter " C ", and immediately and automatically list is rolled to the entry started with letter " C ".
In the display marked by letter (e) and (f), user continues its input, respectively inputting alphabet characters " d " and " e ".In each input, list is rolled to the entry that the character that inputted with user starts.
As shown, user's input is just in time just providing in the application of display list above the viewing area of shown component and is occurring.So, the input of font and other data input that can occur in the same area may be needed to distinguish.So, equipment, before proceeding to identification font self, may need the intention of the input font of discriminating user.
The mode that identification and identification specific user describe the font meant can use multiple different mechanism to realize, be included in " the Gestures without Libraries of the people such as Wobbrock, Toolkits or Training:$ 1 Recognizer for User Interface Prototypes, " UIST ' 07, October 7-10, 2007, Newport, Rhode Island, $ 1 identifier mentioned in USA (ACM978-1-59593-679-2/07/0010) and other identifiers and sorter, the specific mechanism of the font inputted for identification is not critical concerning the mode using font at this, as long as identifier provides enough accuracys.
May need to distinguish inputting with the user that is intended to impel list to roll the input of character in long list.Such differentiation can be carried out in many ways.Such as, bounding box can be built around a part for any initial perpendicular input (wherein list is vertically rolled) or initial perpendicular input, and the aspect ratio of bounding box can be used to infer the intention of user---wherein wider bounding box is by the intention of indicative input font instead of rolling.Bounding box can but need not with input the edge quadrature of screen that occur thereon.Because this technology uses the minimum bounding box of motion, it can distinguish rolling and glyphs effectively.Such as, rolling movement can not be completely vertical---be manyly actually oblique line or slight oblique line.Or user may scroll-up/down list and do not lift finger, and it causes zigzagging.All these still will cause " narrow " bounding box, namely lower under this situation aspect ratio.
Bounding box can also only just be examined when initially knocking and exceeding predetermined minimum length, wherein supposes that very short user moves the intention of not indicative input character, because its painting canvas represented to user about touch-screen is too little.
Further, can consider the original speed dragging motion, wherein quick tap is by the intention of instruction rolling, and inputs the more premeditated intention of indicative input font comparatively slowly.Also the combination of other speed datas or speed data can be used.Such as, vertical movement slowly can indicate the intention of rolling in lists very in a small amount, and movement very fast can indicate the intention of touching list, and the speed of intermediate range can the intention of indicative input font simultaneously.Further, if system is not encoded have the font of perpendicular elements, then any vertical input can be assumed to be the intention that instruction is rolled immediately.Rolling can also make input be intended to character pattern input or roll input initially determine time suppressed, or can start during input font and can continue, then once user completes character pattern input, as roll a part, equipment can jump to list by the part represented by the character corresponding with inputted font.
Further, the character inputted can when it is just transfused to or only after it has inputted by identification.The latter's identification can be triggered by " indicator upwards " event on touch-screen, and the former can relate to when font is just transfused to continue provide delineation information to identifier, and inputted data and possible answer collection are compared, until be all excluded except an answer.At this point, identification can be carried out, even if user not yet completes his or her input.When equipment determining to input font or for roll time, the display of the line of the description of the finger of following user can be made at first to become dim, and once make the determination being intended that input font of user, it just can be made to become brighter, thicker and/or different colors.
Determine except other are determined or in conjunction with other, can also comprise the stress level determining that user applies to the determination of user view, described other determine the angle that such as starts vertically to knock and this speed of knocking.Such as, very light and fast user's input can indicate touches, and the intention of fast scroll.Elevated pressures can indicate more premeditated input, because user is just attempting to sketch out character or other fonts, is therefore intended to draw input instead of roll.
Fig. 2 illustrates a series of screenshotss of programming with self-defined font of mobile touch screen apparatus.Usually, screenshotss show mobile device display, and user inputs self-defined, user-defined font to arrive the user interface items for someone contact person record form of the friend for user wherein.Again, each in screenshotss is occurring in chronological order after front screenshotss.
With letter (a) indicate first show user with in the name of the friend in the contacts list of user alphabetically grow by.Many parts menu shown in the display indicated with letter (b) is taken in such selection out of, wherein represent to user and have following option: check that contact person (such as, see the photo of friend and one or more telephone number and e-mail address), (it is the sublist of such all objects that user may have on their device friend to be added to favorites list, and its can than all list objects on equipment can conveniently represent to user), edit contact is (by illustrating associated person information to user, and allow user to make change to it), delete contact person and be edited into the shortcut of contact person.In the images, the object that user is clicking or length is hit as the contact person record of friend or the option of project editor shortcut.
User selects this option to result in the display specified by letter (c), the painting canvas that wherein display section is transparent above menu and draw for user or describe the instruction of font, the input of described font is after this by interrelated with the contact person record being used for this friend.(when drawing the line of figure, painting canvas is completely transparent, although in fact embodiment can use various visual effect to maintain sense of place in systems in which when their positive input character to allow user.) in this display, user is describing letter " P ", general because the name of friend starts with letter " P "---therefore, be natural learn tool for the suitable font that this user remembers for this friend after a while.
In the display represented by letter (d), user is again for the contact person record of same friend have selected menu " editor's shortcut ", and be in and draw in the process of font with standard pentagram form---may, because user knows all things that this friend is always good at him and did, therefore be star executor.User is also in the process of pressing " interpolation " button, with except described letter " P ", is added to star font in the expression of this friend.
In the display represented by letter (e), user turns back to contacts list, wherein this process starts in display (a), and be in the process describing pentagram, and in the display represented by letter (f), the input of star font is completed, is interpreted as the font of match user input in display (d) by equipment.In the display represented by letter (g), user has touched display and has been rolled to another letter (wherein the input of vertically touching with letter or other fonts being distinguished) to cause it, then by re-entering pentagram in the display represented by letter (h), it is impelled to turn back to the record of the contact method representing this friend.(the dual display of some entries represents along with fast scroll occurs in the drawings, the blur motion of those entries.)
In some cases, standard font can be made to mix with self-defined font.Standard font is the font that the third party of such as software developer distributes, and to customize font be that the user self of equipment draws.Therefore, such as, standard font can be used represent the position in the alphameric listing as music list and contacts list, and can to use self-defined font to represent the equipment concerning user be unique special object.User can also create multiple font for special object, make such as that they can distribute from the alphabetic(al) character of non-english, the rolling of list is impelled, wherein the position of the english character of equivalence that will be rolled in list of list with the input according to such character.
Standard for criterion of identification font can than looser for identifying those of self-defined font.Particularly, standard font is developed for many different people, therefore may need to carry out identification across larger change level, and self-defined font is drawn by specific user, therefore can be had repeatability greatly by hypothesis.Therefore, being allowed for the variability level of such font by " turning down ", can be that self-defined font reduces the prevailing of wrong report identification.
Fig. 3 illustrates a series of screenshotss that the multiple fonts corresponding with object are shown of mobile touch screen apparatus.Generally speaking, these screenshotss represent the display showing and how multiple different font can be distributed to single object, and it is possible multiple similar font with larger variational input that described multiple different font comprises what make to accept user.
In display place represented by letter (a), show the menu control that user selects to be edited into the shortcut of the contact person record of acquaintance, be similar to the selection of the letter (b) in Fig. 2.As the letter (c) in Fig. 2, in the display represented by letter (b) in figure 3, represent the painting canvas drawing or describe font thereon to user, described font in this case user is depicted as lowercase, rapid style of writing " I ".In display place represented by letter (c), user turns back to contacts list, and has inputted lowercase " I ", although it has thinner ring for particular contact record input more previous than user.Under these circumstances, at inputted font to enough degree and the font stored---or at least relevant with current context any font stored does not match, to user, equipment can point out that input is not suitably registered.Such as, the color that user draws letter can become red to indicate failed input from white.As an alternative, equipment can be sounded (such as Bronx cheer (Bronx cheer) or Raspberry (raspberry)), and equipment maybe can be impelled slightly to shake, and some thing is unusual to make user to hear or to feel.
When receiving such notice, in this example, user determines to check that they have been mutually related with the contact person record of this friend font, and have selected this record (it is at the top of display).The display of letter represented by (d) to (h) represents that user has distributed to five different fonts of this contact person record, three wherein in font " L " being similar to capitalization printing are alphabetical, and two expression lowercase rapid style of writing " I " characters in font.User by selecting on the touchscreen or with " last " and " next " control that other appropriate ways show, can make different displays cycle through.In this example, user can see the mistake of font of its input in letter (c), and the practice then can added new font or change its future is better to mate at letter for the font stored shown in the display of (g) and (h).
When font is had ambiguity by identification but its implication, various mechanism can be utilized to solve ambiguity.Such as, if user checks list alphabetically, and by being allocated to the contact person record of playlist, application and friend with the font of alphabetical form, then input and will have ambiguity, because it may represent any one in those objects.In one embodiment, one or more rule can be used to infer the intention of user.Such as, due under the linguistic context of list, equipment can suppose that user is intended to roll in list.As an alternative, if user on the table, then equipment can suppose that user wants to start application.Can apply various priority rule making timing so really, and rule can be revised by specific user and customize.
When the initial input of user has ambiguity, equipment can also allow user to provide follow-up input.Therefore, in the above example, the list object corresponding with the font that user inputs can be represented to graphical user.User then can such as by pressing object or by saying the numeral corresponding with the position of object in shown list, coming from list alternative in display.
In some embodiments, the input of font can be general, and in other embodiments, it can be linguistic context.Further, the input of some font can be only addressed under some linguistic context, and the input of other fonts is addressed under all linguistic context.As an example of latter instance, the font relevant to a certain object of the such as contact person record of activity can be aroused in any linguistic context.
Print train can also be received grand, the script on the equipment of being stored in or other objects.Such as, user may write the grand or script of the various settings changed on its equipment, to mate their their demand operationally, then mates them away from different demands during work---the setting of equipment is effectively changed across multiple different object.In such embodiment, user can impel font to be associated with grand or script, makes when user is no matter on the table or from application during this font of input, all related objects of change automatically on equipment.
Such as, about the search inquiry of user's instruction, can utilize font, no matter font is standard character or user-defined font.Such as, user can draw letter " H " with the history of the website of the nearest access of the equipment caused in the list by reversed time order or list with other appropriate ways.Similarly, user can define the persistence search that he or she is intended to submit to, and this search can be distributed in font.Such as, user may want repeatedly to search for about he self or she self news, and the font of star can be programmed for the searching request being interpreted as comprising his or her name and being submitted to news-related searches engine.Equipment inputs this font from any linguistic context and can impel that browser starts, the submitted and Search Results of search inquiry is delivered to browser.
Fig. 4 is in response to touch-screen input and provides the schematic diagram of the system 400 of user interactions.System 400 can use the mobile device of such as equipment 402 to realize.Equipment 402 comprises various input and output mechanism, such as touch-screen display 404 and roller ball 406.Multiple assemblies in equipment 402 can be configured to, such as by drawing one or more font in display 404, display 404 provide various selection function.
Such assembly is display manager 412, and it can be responsible for rendering content to represent in display 404.Display manager 412 can receive the relevant content of figure from multiple source, and can determine how to provide this content to user.Such as, may need to show the multiple different windows for the various application 410 on equipment 404, and display manager 412 can determine which is to be shown, which is to be concealed and which is to be shown or hiding when existing overlapping between various Drawing Object.Further, when another assembly of equipment 404 pick out user just attempting to draw font in touch-screen display time, display manager can help the position of drawing user to coordinate to generate font in display.
Display manager 412 can comprise provides specific function with the various assemblies with shown component interaction, and it across multiple Application share and can such as can be supplied by the operating system of equipment 402.Inputting font above assembly shown by other can use user's input control device 417 of drafting in the collaborative management of getting off of display manager 412.Such controller can be responsible for identification, and when user is showing input font instead of is performing difference in functionality and the FC of input become the order can explained by other assemblies on equipment.In order to produce such order, by the information of the shape defining the font that user inputs is passed to font interpreter 415, user's input control device 417 of drafting can quote font interpreter.Then the font of input and the standard be stored on equipment and self-defined font can compare by font interpreter 415, and return the identity of font, such as No. ID, font.
The user's input control device 417 drawn may previously map and the action of storing font ID and the generation when particular glyph is transfused to.As a result, such information can be passed to other assemblies of equipment by controller 417.Such as, various application 410 can be stored on equipment and to run on equipment.Such as, when controller 417 represent be mutually related font with contact person record, controller 417 can call contact application, and by the identity passing of this record to contact application, the input to this font in response to user is shown by this record automatically.By this way, controller 417 one can serving as on the core component of operating system and equipment between application intervenes device.
The order that the user that input manager 414 can be responsible for interpreting equipment 402 provides.Such as, such order may from keyboard, touch-screen display 404, description ball 406 or other such sources, comprise dedicated button or soft key (such as, function can As time goes on the button that the button changed and function can show on the region of the adjacent specific button of display 404).Input manager 414 can such as be determined in which region that order is showing received, and therefore order is intended for showing in which application illustrated.In addition, the input motion on touch-screen 404 can be interpreted as command format by it, and by those motions through explaining (such as, short by, long by, to touch and straight line drags) pass to suitable application.Input manager 414 can also report such input to task manager (not shown), task manager and then to suitable module or the such input of application report.When for device activation IME function, the input in soft keyboard region can be passed to IME415 by input manager.
Controller 417 can be registered to input manager 414, with notified user's input on the touchscreen, and can so its specific input is recognized as be the input of drawing time, notice input manager, passes to stop input manager input may be interpreted as being other assemblies of some other thing improperly by input.
Multiple application 410 can the general purpose microprocessor on equipment 402 operate usually.Application 410 can adopt various ways, such as map application, Email and other messages application, web browser application, music and video player and in web browser, run or run the various application of expansion of web browser.Application 410 can comprise other components storing record or have alphanumeric name, therefore, it is possible to draw in the front end of touch-screen 404 application that alphanumeric character carrys out fast access by user.
Wave point 408 manages the communication with wireless network, and this wireless network can be the data network also carrying voice communication.Wave point 408 can such as operate in the mode be familiar with according to following example, and can provide the communicating of messenger service of equipment 402 and such as text message, Email and telephone voice mail message.In addition, wave point 408 can be supported to be downloaded by wireless network and uploading content and computer code.
Such as use shaft collar to drive and/or solid-state memory device, various forms of persistent storage can be provided.Two examples are shown at this.The first, the storage such as list, map 416 comprises the various definition to being stored in the object represented on equipment 402 and by equipment 402.Such object comprises other list objects, the list of the song on such as equipment, TV programme, film or other media.List can also comprise list of file names, and wherein equipment 402 stores a large amount of files.And, other objects of such as map (such as, graphical map tile as looking ahead from remote server), and about the metadata of map, the interested point on the cities and towns on such as map and the title in street and map and the title of enterprise can be stored.
Other storages comprise user and give tacit consent to 418, and it can be the profile information for user be stored on the medium identical with list, map etc. 416.User gives tacit consent to the various parameters that 418 comprise the user about equipment 402.In this associated exemplary, user profiles can comprise the data and the object be associated with the input of those fonts or action that define the various self-defined font that user has inputted.In a variety of forms, such as can come storing font data and other information with one or more XML file or Sqlite file.
Use the assembly described, and for clarity sake in this abridged those, equipment 402 can provide specific action in response to user's input.Particularly, equipment 402 can by by input, to be recognized as be the input that font shortcut responds user, and responded to the input of such data by the position that makes equipment jump to be associated with this font or object.
Fig. 5 A-5D is the process flow diagram of the instantiation procedure of character pattern input for the treatment of the user via computing equipment.Fig. 5 A generally illustrates a process, and by this process, the alphanumeric font inputted on the list that user shows on equipment can impel equipment automatically to jump to reposition in list.
This process starts at frame 502, wherein receives font.Font can be that user had previously programmed to indicate this user to want the form of display list, the list of described list such as contacts list, list of songs or other types.Such as, the shape of treble clef may be programmed into its equipment to represent the intention of the list of songs display made on their mobile devices by user.List is sorted with alphanumeric mode usually, the title such as wherein started with numeral near the top of list and the title that starts with zed near the bottom of list.Font can input with the character style of the path definition by contact point, point of release and the drafting between contact point and point of release.
At frame 504, (such as, by find in the font storehouse stored with font closest to mate, then determine that the font stored mated is assigned to the action of initiation list of songs) by font and list interrelated, and list shows at its rearmost position place.Such as, if list was previously activated, and user has used Another application to start, then with user, list can finally check that the state residing for it shows.In this example, user wants the diverse location jumped in list, and therefore at frame 506, user such as draws the font of alphabetic(al) letter above list in the mode shown in Fig. 1---and wherein in letter representation list, user wants the position jumped to.
At frame 508, first this process determines that user is intended to input font, then identifies the alphanumeric character corresponding with the font that user inputs.Such as, this process can determine that user attempts the particular letter of input alphabet.Therefore, at frame 510, this process makes list roll, and the character that the first file in list is inputted with user starts.Such as, if user have input letter b, list then can be made to roll, make the list of songs for user is shown, the top wherein shown starts with title Badlands, heel The Ballad of John and Yoko, heel Bang, Bang, Bang, Bang (John Lee Hooker) etc.
By this way, user can be allowed to jump to clearly defined position in bulleted list fast, and need not long-time the scroll list up and down.As a result, if user can be required to roll more fast than them and arrive the position of expectation more reliably.Further, user can describe font, and need not check their equipment, controls their equipment when making them can lose absorbed power in other things just do not done them.
Fig. 5 B substantially representation class is similar to the process of the process in Fig. 5 A, but shows other details, and by the details that this is other, equipment can jump to permission user in the reposition in list and operate.This process starts at frame 516, and wherein user inputs font to illustrate the intention making the list of particular type show of user.At frame 518, this process by inputted font and particular list interrelated, and impel list in lists its rearmost position place display.At frame 520, such as by user by finger presses to the touch-screen display that list is just shown, and in display, sketch out path by user, this process receives the input above list of user.
At frame 522, whether this process determines that user inputs is select input.Such as, the object that user raps in display can be intended to select this object by indicating user, such as by selecting name to show on equipment to make the contact person record about selected name in list of names.If input is selected in input, then this process can illustrate choice box 524, then can continue to wait for the other input from user.
At frame 526, whether this process is determined to input with input form of rolling, and whether such as input is user's rapid vertical bang on a display screen.If input is with input form of rolling, then as shown in frame 527, list is rolled to new position by this process, then returns to receive other user's input.
At frame 528, if input is not input of rolling, and be not select input, then this process determines whether input is character pattern input.Can such as by identifying via the bounding box of the line of the initial input of user, and the aspect ratio determining bounding box whether indicating user be intended to input the character of such as font, make such determination.If input is not character pattern input, then this process can return to receive other user's input again.Such input of not mating the input of any institute identification such as can be included in the selection not existing and the viewing area of selectable objects is made.
At frame 530, font is illustrated on screen as it is drawn.Such as, line or broken line can press thereon user and drag the position appearance below the line on the screen of their finger.By this way, indicating equipment its feedback inputted of identification just in the appropriate way can be provided to user, make user can continue to provide input.
At frame 532, this process determines that whether user inputs any font of identification.Such as, this process can use various mechanism the shape for glyphs to be compared with the shape stored of the known font representing such as alphanumeric character.If do not have font by identification, then at frame 536, this process with red display font, and makes font fade away, and it is no longer illustrated to user.By this way, this process is failed to the identification of font to user's instruction, and user should attempt inputting other fonts or performing other actions.Then this action returns to wait for other user's input.
If font is by identification, then at frame 534, this process determines to input whether have ambiguity, and wherein it determines whether the multiple font of identification.If only have a font by identification, then at frame 538, list can be rolled to the character be associated with inputted font by this process immediately.If multiple font can the font that inputs of match user, then this process can in a plurality of ways in one disambiguation is carried out to input.In this example, two different modes input being carried out to disambiguation are shown.First, at frame 540, this process can select the most probable font that user is intended to input from possible candidate's font.Such as, as mentioned above, multiple rule can be used to determine most important font or most probable font.Such as, if user is in application-specific, then can has a preference for the font be clearly associated with this application, and not like more generally font, the font such as will user being impelled to jump to the object in different application.As an alternative, at frame 542, the list of possibility action can be shown to user, and user can select them to be intended to the action of calling when they input font.In either case, list is rolled to the character being confirmed as the character being user view by this process again, and this process returns to receive other input from user.
Fig. 5 C shows the process flow diagram for the method using character pattern input to navigate on geographical map.Generally speaking, this process relates to and receiving with the font of alphanumeric character form or instruction to may other inputs of user interest of the current point do not represented on map, and is automatically swept by map and input corresponding point-of-interest with letter or number character or other.
This process starts at frame 550, and wherein computing equipment shows map to user.Map such as with the form that GOOGLE MAPS (Google Maps) provides, can be made up of multiple tile, and at frame 552, equipment receives user on the surface of map to the input of font.Use as those mechanism above-mentioned, can by font with such as to select or pan on map or convergent-divergent move that other input and distinguish.
At frame 554, the letter or number that this process identification is corresponding with inputted font.In addition, this process can identify the shortcut of user-association to font.At frame 556, the terrestrial reference that this process identification starts with the letter be associated with this font.Terrestrial reference can identify in a multitude of different ways.Such as, when the tile of map is downloaded to equipment from central server, the other metadata of map can be provided together with downloading.Such as, street, terrestrial reference, buildings, enterprise, river, crossroad, area, stadiums, red-letter day and the title of other such objects and the geographical location information of such project can be provided to equipment.When user is on equipment during input inquiry, such metadata may be used for the normal use of equipment.As shown in the process, but the letter of the font that metadata can be inputted with user mates.Therefore, such as, if user skipper by downtown areas find Main Street (main street), then user can input on their screen " M " shape with on the map just shown at them for they locate Main Street.By this way, user can be identified in the terrestrial reference or sundry item that start with particular letter near them fast.
In many cases, the multiple terrestrial references near user will start with same letter.Therefore, user may have ambiguity with formal character pattern input letter concerning equipment.As discussing about list above, specific landmark can be selected by utilizing various selective rule, and showing to user.As an alternative, all terrestrial references in region can be represented to user with tabular form, selects for user.Such as, as mentioned above, when user inputs " M " shape on their device, the restaurant of the multiple McDowell (Paul McDowell) shown by its gold arc may be there is in this region equally, and those restaurants equally can trigger match.In the same way, Maple Street (maple street), Marple Avenue (horse pul main road) and Metrodome can be identified as coupling.
At the letter inputted for user, when there is multiple coupling, frame 558 shows can mark to those terrestrial references based on the importance of terrestrial reference with to the distance of user.Such as, can programme to scoring algorithm, to make when user is just so that relatively high speed is mobile, time such as in its automobile, street name obtains the importance higher than enterprise's name, but when user moves, just more lentamente to indicate them just in walking, and when may find certain shops, enterprise's name obtains the leading power higher than street name.In the same way, can obtain higher than the leading power from the farther terrestrial reference of user close to the terrestrial reference of user.Therefore, in every way, each terrestrial reference of the letter that this process can input for match user produces synthesis score value, then as indicated by block 560, and can to show the terrestrial reference of each coupling to user according to the tabular form of score value sequence (according to descending).
At frame 562, the user that this process receives specific landmark selects, and at frame 564, the display of this process pan map, to make, in display, selected terrestrial reference is shown.When terrestrial reference can not show in single display, such as when terrestrial reference Shi Henchang street, if user continues on the direction of his or she current movement, then such as by determining the following intersection point of user and this terrestrial reference, the ad-hoc location along terrestrial reference can be determined.Further, some terrestrial reference can, after user have selected this terrestrial reference (such as, very large terrestrial reference), cause the zoom level of map to change.
Fig. 5 shows for inputting and the process of movement on map the user of font in response to above map, and this process is similar to the process shown in Fig. 5 C, but the more details of being illustrated.This process starts at frame 570, wherein shows map in the mode be familiar with.At frame 572, above map, receive user's input.At frame 574, whether this process determines that user inputs is select input, and if then at frame 576, perform this input.At frame 578, analyze to determine whether it is character pattern input to input, and if not, then this process returns with the other user's input of wait-receiving mode.If input is character pattern input, then shown as it is drawn by user on screen at frame 580 font.By this way, this process provides feedback to user, and user can be seen, and their input is just processed rightly by equipment.
At frame 582, font drawn (such as, user has lifted his or her finger), and this process determines that it whether can the font of discriminating user input.If font can not be recognized as relevant with the font stored in equipment by this process, then at frame 584, this process with this font of red display, and makes this font fade away, and user is turned back to the input that input is other.Such as, then user can attempt to re-enter this font to make equipment this font of identification again.
If font is by identification, then this process be identified near user to be mutually related with this font, (such as use gps receiver, it can be confirmed as physical location to the terrestrial reference that alphanumeric character starts; Or the center of the map when forward direction user display is such as positioned at by hypothesis user, it is confirmed as inferred position), and it is marked.At frame 588, then this process represents the list of landmarks started with the letter or number of this font, and receives and select the user of in terrestrial reference.At frame 590, this process such as identifies central point and the zoom level for terrestrial reference in the above described manner, and 592, this process is by following end: map denotation is swept new position, is marked on new position with making represents to user.
Generally speaking, Fig. 6 A shows the process for one or more font being distributed to special object, and Fig. 6 B shows the process for showing the font that may be associated with object.The process of Fig. 6 A starts at frame 602, and the user wherein receiving operating system object selects.Such selection can when many dissimilar occur, described situation such as when user want to consult about object details or start the application be associated with object time.Such as, the user of call friends is wanted will frequently to identify the contact person record being used for this friend in contacts list, to start phone application to call out this friend.
At frame 604, this process receives and illustrates that the user of user view font being distributed to object selects.Such as, user recently may become very friendly with specific acquaintance, and may want can than they in the past can this acquaintance of contact quickly.As a result, user may want font to distribute to this friend, and the contact person record for this friend can be taken out of quickly.At frame 606, show character pattern input instruction to user, and user describes in response to this instruction the new font being used for this acquaintance.To form with the background of equipment the color contrasted, the drawing path of user can being shown as broken line, making user can describe his or her progress when drawing font.At frame 608, user has completed drafting font, and this process shows this font to user, and this process receives from user the confirmation that this acquaintance distributed in this font that they are ready to make them draw.If user does not think that they depict font rightly, then they can refuse interrelated for the contact person record of font and this acquaintance, and can again be illustrated that they can attempt again to draw the painting canvas of font.Be intended to once font and object are mutually related by user's instruction, at frame 610, font just can be distributed to object by this process.
At time point after a while, user may just use its equipment, and may want to take object out of immediately, and need not open list, rolls through list and select this object from list.As a result, user then can by character pattern input in its equipment, and at frame 614, the input of font can be interpreted as the user view of seeing object by equipment and process, and automatically can open this object and consult for user.
Fig. 6 B generally illustrates a process, can by drawing font by this process user, and then font is labelled in object by alternative.In particular procedure shown in this, user draws the font of the non-identification of its mobile device at first, and therefore they find object, to enable this object interrelated with this font, and can upper once input this font time automatically taken out of.
The process of Fig. 6 B starts at frame 621, and wherein this process receives user's input of font.At frame 622, it is in multiple fonts stored that user may input on equipment one that this process determines whether this font is recognized as.If it is by identification, then 624, activate the object corresponding with this font, and this process returns to wait for other user's input.If this font is not by identification, be then intended to input for the font of object user, but fail to input rightly current be assigned to the hypothesis of the font of object under, this process can navigate to object by indicating user.At frame 628, user navigates to object, and therefore this process can be linked to the font that user is this objects draw.
At frame 630, user can determine that they want to see other fonts be associated with same target, and they make the selection to that aspect control.This process can by illustrating other fonts to respond to user in all modes as shown in Figure 3.At frame 632, user indicates the intention stopping consulting font, and at frame 632, this process removes character pattern input process.Then this process turns back to its point started, and user can continue mutual with its equipment in the previous manner.
Fig. 7 shows the example of the general purpose computing device 700 and General Mobile computer equipment 750 that can use together with technology described here.Computing equipment 700 is intended to represent various forms of digital machine, such as Laptop Computer, desktop computer, workstation, personal digital assistant, server, blade server, large scale computer and other suitable computing machines.Computing equipment 750 is intended to represent various forms of mobile device, such as personal digital assistant, cell phone, smart mobile phone and other similar computing equipments.Assembly shown in this, its connection and relation and its function are intended to just exemplary, and are not intended to limit the embodiments of the present invention describing in the document and/or advocate.
Computing equipment 700 comprises processor 702, storer 704, memory device 706, is connected to the high-speed interface 708 of storer 704 and high-speed expansion ports 710 and is connected to the low-speed interface 712 of low speed bus 714 and memory device 706.Each in assembly 702,704,706,708,710 and 712 uses various bus interconnection, and optionally can be installed on public mainboard or otherwise install.Processor 702 can process the instruction for performing in computing equipment 700, comprises storage in memory 704 or memory device 706 is used for show on the outside input-output apparatus of the display 716 being such as couple to high-speed interface 708 instruction of the graphical information of GUI.In other embodiments, multiple processor and/or multiple bus and multiple storer and type of memory can optionally be used.Further, can connect multiple computing equipment 700, wherein each equipment provides part must operate (such as, as cluster of server, blade server group or multicomputer system).
Storer 704 is stored in the information in computing equipment 700.In one embodiment, storer 704 is volatile memory-elements.In another embodiment, storer 704 is Nonvolatile memery units.Storer 704 can also be the computer-readable medium of another kind of type, such as magnetic or CD.
Memory device 706 can provide mass memory for computing equipment 700.In one embodiment, memory device 706 can be or comprise computer-readable medium, such as floppy device, hard disc apparatus, compact disk equipment or carrying device, flash memory or other similar solid-state memory device or equipment array, be included in the equipment in storage area network or other configurations.Computer program can be visibly included in information carrier.Computer program can also be included in the instruction of the one or more methods performing such as those methods above-mentioned when being performed.Information carrier is computing machine or machine readable media, such as storer 704, memory device 706, storer on processor 702 or transmitting signal.
High-speed controller 708 manages the bandwidth-intensive operations about computing equipment 700, and low speed controller 712 manages lower bandwidth intensive.Such function is distributed just exemplary.In one embodiment, high-speed controller 708 (such as by graphic process unit or accelerator) is couple to storer 704, display 716, and is couple to the high-speed expansion ports 710 that can accept various expansion card (not shown).In this embodiment, low speed controller 712 is couple to memory device 706 and low-speed expansion port 714.The low-speed expansion port that can comprise various communication port (such as USB, bluetooth, Ethernet, wireless ethernet) can be couple to one or more input-output apparatus of such as keyboard, indicating equipment, scanner, or is such as couple to the networked devices of such as switch or router by network adapter.
As shown in the figure, computing equipment 700 can be realized with multiple different form.Such as, computing equipment 700 may be implemented as standard server 720 or more the time and is implemented in one group of such server.Computing equipment 700 can also be implemented as a part for frame server system 724.In addition, computing equipment 700 can realize in the personal computer of such as laptop computer 722.As an alternative, can by combined from other assemblies in the assembly of computing equipment 700 and the mobile device (not shown) of such as equipment 750.It is one or more that each in such equipment can comprise in computing equipment 700,750, and whole system can be made up of the multiple computing equipments 700,750 intercomed mutually.
Among other components, computing equipment 750 comprise processor 752, storer 764, such as show 754 input-output apparatus, communication interface 766 and transceiver 768.Equipment 750 can also be provided with the memory device of such as micro drives or other equipment to provide other storage.Each in assembly 750,752,764,754,766 and 768 uses various bus interconnection, and some assemblies optionally can be installed on public mainboard or otherwise install.
Processor 752 can perform the instruction in computing equipment 750, comprises the instruction be stored in storer 764.Processor may be implemented as the chipset of the chip comprising the multiple analog-and digital-processor of independent sum.Processor such as can provide the coordination of other assemblies to equipment 750, such as to the control of user interface, the application run by equipment 750 and the radio communication via equipment 750.
Processor 752 can by being couple to the control interface 758 of display 754 and display interface 756 and telex network.Display 754 can be such as TFT LCD (tft liquid crystal display) or OLED (Organic Light Emitting Diode) display or other suitable display techniques.Display interface 756 can comprise for driving display 754 to present the suitable circuit of figure and other information to user.Control interface 758 can receive order from user and order be carried out changing to submit to processor 752.In addition, the external interface 762 communicated with processor 752 can be provided, near field can be carried out with other equipment to make equipment 750 and communicate.External interface 762 such as can provide wire communication in some embodiments, or provides radio communication in other embodiments, and can also use multiple interface.
Storer 764 is stored in the information in computing equipment 750.It is one or more that storer 764 may be implemented as in computer-readable medium, volatile memory-elements or Nonvolatile memery unit.Extended memory 774 can also be provided and be connected to equipment 750 by the expansion interface 772 that can comprise such as SIMM (single row direct insert memory modules) card interface.Such extended memory 774 can provide other storage space for equipment 750, maybe can also store the application for equipment 750 or other information.Particularly, extended memory 774 can comprise instruction to realize or supplementary said process, and can also comprise security information.Therefore, extended memory 774 can such as provide as the security module being used for equipment 750, and can be programmed the instruction that security admission uses equipment 750.In addition, safety applications and other information can provide via SIMM card, are such as placed on SIMM card by identification information in the mode that can not trespass.
Storer as described belowly can comprise such as flash memory and/or NVRAM storer.In one embodiment, computer program is visibly included in information carrier.Computer program is included in the instruction of the one or more methods performing such as those methods above-mentioned when being performed.Information carrier is computing machine or machine readable media, such as storer 764, extended memory 774, storer on processor 752 or can such as by transmitting signal that transceiver 768 or external interface 762 receive.
Equipment 750 can wirelessly be communicated by the communication interface 766 that can comprise digital signal processing circuit in case of need.Communication interface 766 can be provided in the communication under various pattern or agreement, such as GSM voice call, SMS, EMS or MMS message, CDMA, TDMA, PDC, WCDMA, CDMA2000 or GPRS etc.Such as can there is such communication by radio-frequency (RF) transceiver 768.In addition, such as use bluetooth, WiFi or other such transceiver (not shown), junction service can occur.In addition, GPS (GPS) receiver module 770 wireless data that the other navigation that optionally can be used by the application operated on equipment 750 can be provided relevant with position to equipment 750.
Equipment 750 can also use audio codec 760 to communicate audibly, and audio codec 760 can receive spoken message from user and be converted into spendable numerical information.Equally, audio codec 760 such as can pass through the loudspeaker such as in the monophone of equipment 750, for user generates the sound that can hear.Such sound can comprise the sound from voice telephone calls, can comprise the sound (such as, speech message, music file etc.) that recorded and can also comprise the sound generated by the application of operation on equipment 750.
As shown in the figure, computing equipment 750 can be realized with multiple different form.Such as, computing equipment 750 may be implemented as cell phone 780.Computing equipment 750 can also be implemented as the part of smart mobile phone 782, personal digital assistant or other similar mobile devices.
Equipment 750 can also comprise can one or more distinct devices of perceive motion.Example includes but not limited to accelerometer and compass.Accelerometer and compass maybe can detect motion or other equipment of position can obtain from many suppliers, and can perceive motion in many ways.Such as, accelerometer can the change of sense acceleration, and compass can detect the change in the direction relative to magnetic north pole or the South Pole.These changes of motion can be detected by equipment 750, and are used for according to process described here and technology, upgrade the display of relevant device 750.
The various embodiments of system described here and technology can be realized with Fundamental Digital Circuit, integrated circuit, custom-designed ASIC (special IC), computer hardware, firmware, software and/or above combination.These various embodiments can be included in the embodiment that programmable system can perform and/or in explainable one or more computer program, described programmable system comprises at least one programmable processor, it can be special or general, is coupled receive data and instruction from storage system, at least one input equipment and at least one output device and transmit data and instruction to storage system, at least one input equipment and at least one output device.
These computer programs (being also referred to as program, software, software application or code) comprise the machine instruction for programmable processor, and can realize with advanced procedures and/or OO programming language and/or compilation/machine language.As used in this, term " machine readable media ", " computer-readable medium " refer to that any computer program from data to programmable processor, device and/or equipment for providing machine instruction and/or are (such as, disk, CD, storer, programmable logic device (PLD)), comprise the machine readable media received as the machine instruction of machine-readable signal.Term " machine-readable signal " refers to any signal for providing machine instruction and/or data to programmable processor.
Mutual in order to what provide with user, system described here and technology can realize having on following computing machine: for showing the display device of information (such as to user, CRT (cathode-ray tube (CRT)) or LCD (liquid crystal display) monitor), and user can provide keyboard and the indicating equipment (such as, mouse or tracking ball) of input by it to computing machine.What also can use the equipment of other types to provide with user is mutual; Such as, the feedback being supplied to user can be any type of perceptible feedback (such as, visual feedback, audio feedback or tactile feedback); And can in any form, comprise acoustics, speech or the input of sense of touch, receive the input from user.
System described here and technology can comprise aft-end assembly (such as data server) comprise middleware component (such as application server) or comprise front end assemblies (such as having user can the client computer of the graphic user interface mutual with the embodiment of system described here and technology or Web browser by it) or such rear end, middleware or front end assemblies any combination computing system in realize.The assembly of system can be interconnected by the digital data communication (such as communication network) of any form or medium.The example of communication network comprises LAN (Local Area Network) (" LAN "), wide area network (" WAN ") and the Internet.
Computing system can comprise client and server.Client and server usually away from each other and mutual typically via communication network.The relation of client and server relies on operation on the respective computers and has the computer program generation of client-server relation each other.
Describe multiple embodiment.But, will be appreciated that when not deviating from the spirit and scope of the present invention, can various amendment be carried out.Such as, Reference News and map application describe the major part of this document, but also can propose other forms of graphical application, such as interactive program guide, web page navigation and convergent-divergent and other such application.
In addition, the logic flow described in accompanying drawing does not need shown particular order or consecutive order to reach the result of expectation.In addition, other steps can be provided, or from described flow process removing step, and other assemblies can be added to described system or remove assembly from described system.Therefore, other embodiments within the scope of the claims.

Claims (11)

1. a computer implemented method for user interface, comprising:
First subdivision of display items display list in the region of the touch-screen of computing equipment;
Be received in the input of the drafting in the described region of described touch-screen from the user of described equipment, wherein show described first subdivision of described bulleted list in the described region of described touch-screen while, receive at least some in the input of described drafting;
Determine that the input of described drafting comprises rolling input for described bulleted list or the entry of font;
Determine that the input of described drafting is corresponding with the particular glyph of the specific project distributed in described bulleted list; And
In response to determining that the input of described drafting is corresponding with described particular glyph, in the described region of described touch-screen, the described bulleted list of display comprises the second subdivision of described specific project automatically.
2. method according to claim 1, receives the input of described drafting on the described subdivision that the input being wherein received in the described drafting on described touch-screen is included in described bulleted list.
3. method according to claim 1, wherein determine the input of described drafting comprise for described bulleted list rolling input or the entry of font comprises: the bounding box of entry identifying the part being used for described font.
4. method according to claim 1, comprises further: if the input of described drafting is not by identification, then provide the visual fail indicator maybe can listened to described user.
5. method according to claim 4, wherein said fail indicator comprises the input showing described drafting to form the color contrasted with the color previously showing the input of described drafting.
6. method according to claim 1, the input of wherein said drafting is defined by following: contact with the indicator of described touch-screen and the indicator of described touch-screen subsequently discharges, and the indicator path between described indicator contact with the release of described indicator described on described touch-screen.
7. method according to claim 1, the described specific project in wherein said second subdivision is assigned to described font by the user of described computing equipment.
8. method according to claim 1, the one or more projects in wherein said second subdivision are associated with described font by third party software developer.
9. a user interface system, described system comprises:
For the device of the first subdivision of display items display list in the region of the touch-screen of computing equipment;
For being received in the device of the input of the drafting in the described region of described touch-screen from the user of described computing equipment, wherein show described first subdivision of described bulleted list in the described region of described touch-screen while, receive at least some in the input of described drafting;
For determining that the input of described drafting comprises rolling input for described bulleted list or the bar destination device of font;
For determining the device that the input of described drafting is corresponding with the particular glyph of the specific project distributed in described bulleted list; And
For in response to determining that the input of described drafting is corresponding with described particular glyph, in the described region of described touch-screen, automatically show the device that described bulleted list comprises the second subdivision of described specific project.
10. system according to claim 9, the input of wherein said drafting is defined by following: contact with the indicator of described touch-screen and the indicator from described touch-screen subsequently discharges, and the indicator path between described indicator contact with the release of described indicator described on described touch-screen.
11. systems according to claim 9, wherein determine the input of described drafting comprise for described bulleted list rolling input or the entry of font comprises: the bounding box of entry identifying the part being used for described font.
CN201080024993.6A 2009-04-10 2010-04-08 Glyph entry on computing device Active CN102460362B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/422,185 US8819597B2 (en) 2009-04-10 2009-04-10 Glyph entry on computing device
US12/422,185 2009-04-10
PCT/US2010/030417 WO2010118247A1 (en) 2009-04-10 2010-04-08 Glyph entry on computing device

Publications (2)

Publication Number Publication Date
CN102460362A CN102460362A (en) 2012-05-16
CN102460362B true CN102460362B (en) 2015-03-11

Family

ID=42315456

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201080024993.6A Active CN102460362B (en) 2009-04-10 2010-04-08 Glyph entry on computing device

Country Status (7)

Country Link
US (1) US8819597B2 (en)
EP (1) EP2417516B1 (en)
JP (1) JP2012523633A (en)
KR (1) KR101711110B1 (en)
CN (1) CN102460362B (en)
MX (1) MX2011010676A (en)
WO (1) WO2010118247A1 (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8633930B2 (en) * 2007-03-26 2014-01-21 Apple Inc. Non-linear text flow
US8594740B2 (en) 2008-06-11 2013-11-26 Pantech Co., Ltd. Mobile communication terminal and data input method
US20110055753A1 (en) * 2009-08-31 2011-03-03 Horodezky Samuel J User interface methods providing searching functionality
CN101661373B (en) * 2009-09-29 2013-02-27 中兴通讯股份有限公司 Method and device for identifying unlocking by contact surface type
US9021402B1 (en) 2010-09-24 2015-04-28 Google Inc. Operation of mobile device interface using gestures
US20120096354A1 (en) * 2010-10-14 2012-04-19 Park Seungyong Mobile terminal and control method thereof
CN102645990A (en) * 2011-02-18 2012-08-22 瑞轩科技股份有限公司 System for controlling and displaying picture information on controllable device and application method thereof
US20120216152A1 (en) * 2011-02-23 2012-08-23 Google Inc. Touch gestures for remote control operations
US20120280927A1 (en) * 2011-05-04 2012-11-08 Ludwig Lester F Simple touch interface and hdtp grammars for rapid operation of physical computer aided design (cad) systems
US8793624B2 (en) 2011-05-18 2014-07-29 Google Inc. Control of a device using gestures
DE102011110974A1 (en) * 2011-08-18 2013-02-21 Volkswagen Aktiengesellschaft Method and device for operating an electronic device and / or applications
DE102011112443A1 (en) * 2011-09-03 2013-03-07 Dr.Ing.H.C. F. Porsche Ag Method and device for providing a user interface in a vehicle
US8478777B2 (en) * 2011-10-25 2013-07-02 Google Inc. Gesture-based search
KR101873741B1 (en) * 2011-10-26 2018-07-03 엘지전자 주식회사 Mobile terminal and method for controlling the same
US10430066B2 (en) * 2011-12-06 2019-10-01 Nri R&D Patent Licensing, Llc Gesteme (gesture primitive) recognition for advanced touch user interfaces
US8504842B1 (en) 2012-03-23 2013-08-06 Google Inc. Alternative unlocking patterns
KR101395480B1 (en) * 2012-06-01 2014-05-14 주식회사 팬택 Method for activating application based on handwriting input and terminal thereof
US20130339859A1 (en) 2012-06-15 2013-12-19 Muzik LLC Interactive networked headphones
JP5852928B2 (en) * 2012-06-27 2016-02-03 株式会社オプティム Operation input device, operation input method and program
US9110587B2 (en) 2012-07-13 2015-08-18 Samsung Electronics Co., Ltd. Method for transmitting and receiving data between memo layer and application and electronic device using the same
CN106527759B (en) * 2012-07-13 2019-07-26 上海触乐信息科技有限公司 The system and method for portable terminal taxi operation auxiliary information input control function
GB201215283D0 (en) * 2012-08-28 2012-10-10 Microsoft Corp Searching at a user device
US9147058B2 (en) * 2012-10-12 2015-09-29 Apple Inc. Gesture entry techniques
US9372970B2 (en) 2012-10-12 2016-06-21 Apple Inc. Gesture entry techniques
EP2722745A1 (en) * 2012-10-17 2014-04-23 Advanced Digital Broadcast S.A. A method for operating a gesture-controlled graphical user interface
US8640046B1 (en) 2012-10-23 2014-01-28 Google Inc. Jump scrolling
JP6003622B2 (en) * 2012-12-21 2016-10-05 ブラザー工業株式会社 Printing device
US20140223382A1 (en) * 2013-02-01 2014-08-07 Barnesandnoble.Com Llc Z-shaped gesture for touch sensitive ui undo, delete, and clear functions
KR101373552B1 (en) * 2013-02-14 2014-03-12 주식회사 한국스테노 A stenography equipped with a touch-screen
GB2511044A (en) 2013-02-20 2014-08-27 Ibm Capturing diacritics on multi-touch devices
KR102203885B1 (en) * 2013-04-26 2021-01-15 삼성전자주식회사 User terminal device and control method thereof
KR102063103B1 (en) * 2013-08-23 2020-01-07 엘지전자 주식회사 Mobile terminal
JP5969441B2 (en) * 2013-08-30 2016-08-17 京セラドキュメントソリューションズ株式会社 Search program and search device
JP6178741B2 (en) * 2013-09-24 2017-08-09 京セラドキュメントソリューションズ株式会社 Electronics
US9727636B2 (en) 2013-09-30 2017-08-08 Microsoft Technology Licensing, Llc Generating excutable code from complaint and non-compliant controls
US9558716B2 (en) 2014-05-05 2017-01-31 Here Global B.V. Method and apparatus for contextual query based on visual elements and user input in augmented reality at a device
FR3022369A1 (en) * 2014-06-17 2015-12-18 Orange METHOD FOR SELECTING AN ITEM IN A LIST
DE202015006142U1 (en) 2014-09-02 2015-12-09 Apple Inc. Electronic touch communication
CN107210950A (en) 2014-10-10 2017-09-26 沐择歌有限责任公司 Equipment for sharing user mutual
JP2016110518A (en) * 2014-12-09 2016-06-20 キヤノン株式会社 Information processing equipment, control method thereof, program, and storage medium
CN104539801B (en) * 2014-12-30 2017-01-04 杭州华为数字技术有限公司 Method and terminal for presenting contact information
US9892167B2 (en) * 2015-03-31 2018-02-13 Rovi Guides, Inc. Methods and systems for generating cluster-based search results
CN104898946B (en) * 2015-05-25 2018-08-31 联想(北京)有限公司 A kind of control method and electronic equipment
CN105138263A (en) * 2015-08-17 2015-12-09 百度在线网络技术(北京)有限公司 Method and device for jumping to specific page in application
CN109032379B (en) * 2018-07-25 2023-06-02 维沃移动通信有限公司 Language option display method and terminal
CN110308898A (en) * 2019-07-06 2019-10-08 朱洪俊 It is a kind of that the gift book software systems of export printing are provided
WO2021054934A1 (en) * 2019-09-16 2021-03-25 Hewlett-Packard Development Company, L.P. Hand engagement interface
TWI730539B (en) * 2019-10-09 2021-06-11 開曼群島商粉迷科技股份有限公司 Method for displaying dynamic digital content, graphical user interface and system thereof

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5864635A (en) * 1996-06-14 1999-01-26 International Business Machines Corporation Distinguishing gestures from handwriting in a pen based computer by stroke analysis

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4972496A (en) * 1986-07-25 1990-11-20 Grid Systems Corporation Handwritten keyboardless entry computer system
US4988981B1 (en) 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US5252951A (en) 1989-04-28 1993-10-12 International Business Machines Corporation Graphical user interface with gesture recognition in a multiapplication environment
JPH0773190A (en) * 1993-04-29 1995-03-17 Matsushita Electric Ind Co Ltd Pictograph naming for pen base computer system
US5500937A (en) * 1993-09-08 1996-03-19 Apple Computer, Inc. Method and apparatus for editing an inked object while simultaneously displaying its recognized object
DE69533479T2 (en) * 1994-07-01 2005-09-22 Palm Computing, Inc., Los Altos CHARACTER SET WITH CHARACTERS FROM MULTIPLE BARS AND HANDWRITING IDENTIFICATION SYSTEM
JP2845149B2 (en) * 1994-12-28 1999-01-13 日本電気株式会社 Handwritten character input device and handwritten character input method
US6057845A (en) 1997-11-14 2000-05-02 Sensiva, Inc. System, method, and apparatus for generation and recognizing universal commands
US7840912B2 (en) 2006-01-30 2010-11-23 Apple Inc. Multi-touch gesture dictionary
US6573883B1 (en) 1998-06-24 2003-06-03 Hewlett Packard Development Company, L.P. Method and apparatus for controlling a computing device with gestures
US6407679B1 (en) * 1998-07-31 2002-06-18 The Research Foundation Of The State University Of New York System and method for entering text in a virtual environment
US6791537B1 (en) * 2001-07-06 2004-09-14 Mobigence, Inc. Display of ink for hand entered characters
JP2003225209A (en) * 2001-11-22 2003-08-12 Nec Corp Electronic information recording system and control program
US6938222B2 (en) * 2002-02-08 2005-08-30 Microsoft Corporation Ink gestures
US7096432B2 (en) 2002-05-14 2006-08-22 Microsoft Corporation Write anywhere tool
US7079713B2 (en) * 2002-06-28 2006-07-18 Microsoft Corporation Method and system for displaying and linking ink objects with recognized text and objects
US7002560B2 (en) * 2002-10-04 2006-02-21 Human Interface Technologies Inc. Method of combining data entry of handwritten symbols with displayed character data
US20040145574A1 (en) * 2003-01-29 2004-07-29 Xin Zhen Li Invoking applications by scribing an indicium on a touch screen
KR20040083788A (en) * 2003-03-25 2004-10-06 삼성전자주식회사 Portable communication terminal capable of operating program using a gesture command and program operating method using thereof
EP1639441A1 (en) * 2003-07-01 2006-03-29 Nokia Corporation Method and device for operating a user-input area on an electronic display device
US7831933B2 (en) * 2004-03-17 2010-11-09 Leapfrog Enterprises, Inc. Method and system for implementing a user interface for a device employing written graphical elements
US9008447B2 (en) 2004-04-01 2015-04-14 Google Inc. Method and system for character recognition
US7372993B2 (en) * 2004-07-21 2008-05-13 Hewlett-Packard Development Company, L.P. Gesture recognition
US7719523B2 (en) * 2004-08-06 2010-05-18 Touchtable, Inc. Bounding box gesture recognition on a touch detecting interactive display
JP2006293970A (en) * 2005-03-15 2006-10-26 Ricoh Co Ltd Image processor, image processing method and image processing program
US20070273674A1 (en) 2005-03-18 2007-11-29 Searete Llc, A Limited Liability Corporation Machine-differentiatable identifiers having a commonly accepted meaning
US7786975B2 (en) 2005-12-23 2010-08-31 Apple Inc. Continuous scrolling list with acceleration
US7694240B2 (en) * 2006-11-22 2010-04-06 General Electric Company Methods and systems for creation of hanging protocols using graffiti-enabled devices
US8060841B2 (en) * 2007-03-19 2011-11-15 Navisense Method and device for touchless media searching
US8094939B2 (en) * 2007-06-26 2012-01-10 Microsoft Corporation Digital ink-based search
US7949157B2 (en) 2007-08-10 2011-05-24 Nitin Afzulpurkar Interpreting sign language gestures

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5864635A (en) * 1996-06-14 1999-01-26 International Business Machines Corporation Distinguishing gestures from handwriting in a pen based computer by stroke analysis

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Palm.Handbook for the Palm Zire 71 Handheld.《Handbook for the Palm Zire 71 Handheld》.2003, *

Also Published As

Publication number Publication date
MX2011010676A (en) 2012-03-16
EP2417516A1 (en) 2012-02-15
JP2012523633A (en) 2012-10-04
KR101711110B1 (en) 2017-03-13
KR20120013377A (en) 2012-02-14
US8819597B2 (en) 2014-08-26
WO2010118247A1 (en) 2010-10-14
US20100262905A1 (en) 2010-10-14
EP2417516B1 (en) 2018-12-19
CN102460362A (en) 2012-05-16

Similar Documents

Publication Publication Date Title
CN102460362B (en) Glyph entry on computing device
EP3469477B1 (en) Intelligent virtual keyboards
CN108701138B (en) Determining graphical elements associated with text
KR102121487B1 (en) Managing real-time handwriting recognition
US8914743B2 (en) Device, method, and graphical user interface for navigating a list of identifiers
US8060841B2 (en) Method and device for touchless media searching
CN102156614B (en) Device, method, and graphical user interface for manipulating tables using multi-contact gestures
CN103649876B (en) Performing actions on a computing device using a contextual keyboard
US8862576B2 (en) Device, method, and graphical user interface for mapping directions between search results
US20170357521A1 (en) Virtual keyboard with intent-based, dynamically generated task icons
US20170308247A1 (en) Graphical keyboard application with integrated search
US20110202493A1 (en) Translating User Interaction With A Touch Screen Into Text
CN102033710A (en) Method for managing file folder and related equipment
CN102439544A (en) Interaction with ime computing device
EP2846274A2 (en) Contact searching method and apparatus, and applied mobile terminal
US9507516B2 (en) Method for presenting different keypad configurations for data input and a portable device utilizing same
CN101369209A (en) Hand-written input device and method for complete mixing input
CN105929978A (en) Input method control method and intelligent terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1168928

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: American California

Patentee after: Google limited liability company

Address before: American California

Patentee before: Google Inc.

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1168928

Country of ref document: HK