WO2018053695A1

WO2018053695A1 - Pressure-based selection of additional characters

Info

Publication number: WO2018053695A1
Application number: PCT/CN2016/099504
Authority: WO
Inventors: 毕小俊
Original assignee: 谷歌公司
Priority date: 2016-09-20
Filing date: 2016-09-20
Publication date: 2018-03-29

Abstract

Provided is a computing device. The computing device outputs a graphic keyboard to display and receive an indication of a gesture input for selecting one or more keys of the graphic keyboard. The indication of the gesture input comprises pressure information associated with the gesture input. The computing device determines a candidate character string associated with two or more additional character styles at least partially on the basis of the indication of gesture input. The computing device selects a specific additional character style from the two or more additional character styles on the basis of the pressure information, and outputs a graphic indication of candidate character strings comprising an indication of the specific additional character style for display.

Description

Select additional symbols based on pressure

Background technique

Some computing devices provide a graphical keyboard for entering text as part of a graphical user interface. A "gesture keyboard" is an example of a graphical keyboard that enables a computing device to determine a text string based on continuous gesture input. The continuous gesture input can include a single, continuous gesture that spans the positions of the plurality of keys of the gesture keyboard, rather than multiple, separate tap gesture inputs entered at each of the various locations of the plurality of keys. A gesture keyboard may be preferred for users who prefer to swipe across the keys of the graphical keyboard rather than just tapping on them.

While some gesture keyboards provide enough keys to select all of the different characters that are used to write text in a particular language, some languages rely on additional characters, diacritic (eg, accent, 腭Tilde, cedilla, etc., and other tokens that are not available or at least not easily selected by swiping or tapping at one or more keys. For example, Pinyin is a language system for writing Chinese characters using traditional Roman characters. In addition to relying on traditional Roman characters, Pinyin also includes four different additional symbols that specify a linguistic tone. When a particular additional symbol is placed over a portion of the pinyin, the additional symbol represents the particular linguistic tone used in the pronunciation of that portion of the audio. In the absence of a tone indicator, a single pinyin can be associated with a large number of Chinese characters. Therefore, failure to specify a tone can cause a lot of ambiguity. Since conventional (eg, QWERTY) graphical keyboards may not provide a simple or intuitive way for the user to specify one or more tones of pinyin, the user may choose to ignore the additional symbols when writing the pinyin using the graphical keyboard.

Summary of the invention

In one example, the present disclosure is directed to a method comprising: outputting, by a computing device, a graphical keyboard for display, receiving, by the computing device, selecting the graphical keyboard An indication of a gesture input of one or more keys, wherein the indication of the gesture input includes pressure information associated with the gesture input, and the said computer is at least in part based on the gesture input An indication to determine a candidate string, wherein the candidate string is associated with two or more additional symbol patterns, wherein at least one of the two or more additional symbol patterns includes at least one additional symbol . The method further includes selecting, by the computing device, a particular additional symbol pattern from the two or more additional symbol patterns based on the pressure information; and outputting, by the computing device, a graphical indication of the candidate character string for use In the display, wherein the graphic indication of the candidate character string includes an indication of the particular additional symbol pattern.

In another example, a computing device is described that includes at least one processor and at least one module. The at least one module is operative by the at least one processor to output a graphical keyboard for display, receiving an indication of a gesture input selecting one or more keys of the graphical keyboard, based at least in part on the gesture input The indication to determine a candidate character string, wherein the candidate character string is associated with two or more additional symbol patterns, wherein at least one of the two or more additional symbol patterns includes at least one An additional symbol; and selecting a particular additional symbol pattern from the two or more additional symbol patterns based on pressure information associated with the indication of the gesture input. The at least one module is further operative by the at least one processor to output a graphical indication of the candidate character string for display, wherein the graphical indication of the candidate character string includes the particular additional symbol pattern Instructions.

In another example, a computer readable storage medium encoded with instructions that, when executed, causes at least one processor of a computing device to output a graphical keyboard for display, receiving a selection of the graphical keyboard An indication of a gesture input of one or more keys, wherein the indication of the gesture input includes pressure information associated with the gesture input, and determining a candidate string based at least in part on the indication of the gesture input Wherein the candidate character string is associated with two or more additional symbol styles, wherein at least one of the two or more additional symbol styles includes at least one additional symbol. The instructions, when executed, further cause at least one processor to be based on the Pressure information to select a particular additional symbol pattern from the two or more additional symbol patterns; and outputting a graphical indication of the candidate string for display, wherein the graphical indication of the candidate string includes the An indication of a particular additional symbol style.

The details of one or more examples are set forth in the drawings and the description below. Other features, objects, and advantages of the invention will be apparent from the description and appended claims.

DRAWINGS

1 is a conceptual diagram illustrating an example computing device configured to select an additional symbol pattern based on pressure information associated with gesture input detected at a gesture keyboard, in accordance with one or more aspects of the present disclosure.

2 is a block diagram illustrating an example computing device configured to select an additional symbol pattern based on pressure information associated with gesture input detected at a gesture keyboard, in accordance with one or more aspects of the present disclosure.

3 is a block diagram illustrating an example computing device configured to output a graphical indication of an additional symbol pattern for display at a remote computing device, in accordance with one or more techniques of the present disclosure.

4A is a diagram illustrating different gesture inputs made at a gesture keyboard of an example computing device configured to select additional symbol patterns based on pressure information associated with gesture input, in accordance with one or more aspects of the present disclosure. A graph of the change in pressure during the test.

4B-4E are exemplary computing devices configured to select additional symbol patterns based on pressure information associated with gesture input, in response to gesture input associated with FIG. 4A, in accordance with one or more aspects of the present disclosure. An example graphical indication is displayed.

5 is a flow diagram illustrating example operations performed by an example computing device configured to select additional symbols based on pressure information associated with gesture inputs detected at a gesture keyboard, in accordance with one or more aspects of the present disclosure. .

Detailed ways

In general, the present disclosure relates to enabling a computing device to determine, based on pressure information associated with a gesture input at a graphical keyboard, for determining that the input has been made according to the gesture A specific additional symbolic pattern of one or more additional symbols displayed together with the specified string. As used herein, the term "additional symbol style" is used to describe a sequence of additional symbols associated with a particular term in a language or language system. In some examples, the additional symbol style may have a single additional symbol (eg, an additional symbol associated with one of the strings) or multiple additional symbols (eg, each of two or more letters in the string) The letters are associated with the corresponding additional symbols). In other examples, the additional symbol style may not have an additional symbol.

The example computing device may initially output a graphical user interface (GUI) graphical keyboard for display at the display device. The example computing device can detect a gesture made by an input object (eg, a finger or a stylus) at a plurality of locations of the pressure sensitive input device that corresponds to the location of the keys of the gesture keyboard displayed by the display device. Based on the detected gesture, the example computing device can determine a selection of one or more keys and use the selection of the keys to determine a character string corresponding to the gesture input.

In some cases, a string may be associated with one or more additional symbol styles of one or more additional symbols (eg, where the string is a pinyin having more than one meaning depending on its linguistic tone) And the user may wish to avoid ambiguity and specify a particular additional symbol style to display with the string. Rather than requiring the user to provide additional input and/or navigate away from the graphical keyboard (eg, to different portions of the GUI) to select each additional symbol that is displayed with the string, the computing device may allow the user to change the user while providing gesture input. The amount of pressure applied to the pressure sensitive input device specifies an additional symbol pattern in the additional symbol style. The computing device may select an additional symbol pattern that includes additional symbols having a shape or other characteristic that corresponds to a change in the amount or pressure of pressure detected by the pressure sensitive input device while receiving the gesture input.

For example, if the user wishes to specify a constant pinyin tone for at least a portion of the pinyin, the user can use a nearly constant amount of pressure to provide gesture input when selecting a key for entering pinyin. If the user wishes to specify an increasing pinyin tone, the user can pass the initial A lesser amount of pressure is used during the initial portion of the gesture input and the gesture input is provided by subsequently using a greater amount of pressure or the like during subsequent portions of the gesture input. In this manner, in an example where the computing device recognizes that a string is associated with two or more additional symbol styles, the computing device can select a particular addition in the additional symbol style based on the pressure information associated with the gesture input. Symbol style.

Thus, unlike other computing devices that may not provide a simple or intuitive way for a user to specify additional symbols (eg, one or more tones of pinyin) while continuing to interact with the character keys of the graphical keyboard, the techniques described herein may The computing device is enabled to utilize the pressure determined based on the gesture input at the gesture keyboard to discern which additional symbol is displayed when displaying the character string that has been determined based on the gesture input. Accordingly, the techniques of the present disclosure may improve the overall input speed and the accuracy of the gesture keyboard by providing a method of simultaneously specifying additional symbols when providing gesture input for entering words.

1 is a conceptual diagram illustrating an example computing device configured to select an additional symbol pattern based on pressure information associated with gesture input detected at a gesture keyboard, in accordance with one or more aspects of the present disclosure. In the example of FIG. 1, computing device 100 can be a mobile phone. However, in other examples, computing device 100 can be a tablet computer, a personal digital assistant (PDA), a laptop computer, a portable gaming device, a portable media player, an e-book reader, a computerized watch, a television platform, Or other types of computing devices.

As shown in FIG. 1, computing device 100 includes a user interface device (UID) 112. UID 112 of computing device 100 can function as an input device - specifically acting as a pressure sensitive input device and as an output device. UID 112 can be implemented using a variety of techniques. For example, UID 112 can function as an input device that uses presence sensitive input devices such as resistive touch screens, surface acoustic wave touch screens, capacitive touch screens, transmissive capacitive touch screens, pressure sensitive screens, acoustic pulse wave recognition touch screens, or another presence sensitive input device technology. The UID 112 can function as an output device using any one or more of the following: a liquid crystal display (LCD), a dot matrix display, a light emitting diode (LED) display, an organic light emitting diode An (OLED) display, electronic ink, or similar monochrome or color display capable of outputting visual information to a user of computing device 100.

The UID 112 of the computing device 100 can include a presence sensitive screen (eg, a presence sensitive display) that can receive haptic user input from a user of the computing device 100. UID 112 may be received by detecting one or more tap and/or non-tap gestures from a user of computing device 100 (eg, the user touches or points to one or more locations of UID 112 with a finger or stylus) An indication of the tactile user input. The presence sensitive screen of UID 112 can present an output to the user. UID 112 may present the output as a user interface (eg, user interface 114) that may be associated with functionality provided by computing device 100. For example, UID 112 can present various user interfaces of applications (eg, electronic messaging applications, internet browser applications, etc.) executed at computing device 100. A user of computing device 100 can interact with each application to perform functions with computing device 100 through respective user interfaces with one or more of these applications.

Computing device 100 can include a user interface ("UI") module 120 and a keyboard module 122. Module 120 and module 122 may perform the operations described using software, hardware, firmware, or a mixture of hardware, software, and firmware residing in or executing on computing device 100. Computing device 100 can utilize multiple processors to execute module 120 and module 122. Computing device 100 can execute module 120 and module 122 as virtual machines executing on the underlying hardware.

The UI module 120 of the computing device 100 can receive one or more indications of user input detected at the UID 112 from the UID 112. In general, each time UID 112 receives an indication of user input detected at the location of UID 112, UI module 120 may receive information regarding the user input from UID 112.

For example, UID 112 can virtually overlay the coordinate grid on UID 112. This grid may not be displayed by UID 112. The grid assigns coordinates including horizontal component (X) and vertical component (Y) to each location. The UI module 120 is detected each time the UID 112 detects a gesture input. Information can be received from UID 112. The information may include one or more coordinate locations and associated times, both indicating to the UI module 120 where the UID 112 detected the gesture input at the UID 112 and when the UID 112 detected the gesture input. The information may further include pressure information indicating the amount of pressure or amount of force applied by the user on the UID 112. The pressure information can be in the form of a numerical value, a quantified data point (eg, "0.73 unit force"), or a discrete level (eg, "light", "medium", "heavy", etc.). In some embodiments, the pressure information can be represented as a depth component (Z) that is part of the grid coordinates (eg, X, Y) described above.

The UI module 120 can aggregate the information received from the UID 112 into a sequence of time-ordered touch events. For example, each touch event in the sequence can include data or components representing a parameter that characterizes the presence of an input at UID 112, the amount of pressure associated with the input, and/or the movement of the input (eg, When, where, the starting direction). Each touch event in the sequence can include a position component (e.g., x, y coordinates of the location at UID 112), a time component associated with when UID 112 detected the user input at the location, indicating that detection is detected at the location The amount of force detected by the UID 112 at the time of input or the pressure component of the amount of pressure, and the action component associated with the touch event corresponding to a lift up or a push down at that position.

In addition to time, location, and stress, UI module 120 can determine one or more other characteristics of the user input and include information about the one or more characteristics within each touch event in the sequence of touch events. For example, the UI module 120 can determine a starting position of the user input, an ending position of the user input, a density of a portion of the user input, a speed of a portion of the user input, a direction of a portion of the user input, and a curvature of a portion of the user input. One or more touch events in the sequence of touch events (in addition to the time component, position component, action component described above) may include a character component that includes information about one or more characteristics of the user input (eg, pressure, Density, speed, etc.).

The UI module 120 can cause the UID 112 to present the user interface 114. User interface 114 Graphical elements displayed at various locations of the UID 112 are included. FIG. 1 illustrates an edit region 106A and a gesture keyboard 106B of the user interface 114. Gesture keyboard 106B is a graphical keyboard with selectable graphical elements that are displayed as keys for typing text in editing area 106A. Editing area 106A may include graphical elements, such as images, objects, hyperlinks, characters of text (eg, strings), etc., and computing device 100 generates the graphical elements in response to input associated with gesture keyboard 106B. In some examples, editing area 106A is associated with a messaging application, a word processing application, an internet web browser application, or an application, operating system, or other text input field of the platform executed at computing device 100. In other words, the editing region 106A represents the final destination of the letter or character selected by the user of the computing device 100 using the gesture keyboard 106B and is not an intermediate region associated with the gesture keyboard 106B, such as a word that displays one or more complete word suggestions or auto corrections. Suggest or automatically correct the area.

As shown in FIG. 1, user interface 114 includes the letters m-u-q-i-n within edit region 106A. The letter m-u-q-i-n constitutes a character string or candidate word 130. Candidate words 130 are depicted in dashed circles in the example of FIG. 1, however in some examples UI device 112 may or may not output such dashed circles. Candidate words 130 can be part of a word and/or a portion of a word or word included in the dictionary.

In addition to the letters m-u-q-i-n, the candidate words 130 are also shown as having two additional symbols 'ˇ' and '–' located above the characters 'u' and 'i'. That is, the candidate word 130 represents the pinyin of the word "mother" and two additional symbols are displayed above the corresponding portion of the candidate word 130 to specify the appropriate tone to use in the pronunciation of the pinyin.

FIG. 1 also shows a path 136 of a solid line segment that is presented as a position that spans the keys of the gesture keyboard 106B. The UI module 120 may cause the UID 112 to present the path 136 based on information received from the UI module 120 regarding the location of the gesture detected by the UID 112. In other words, the UI module 120 can cause the UID 112 to display the path 136 at the UID 112 such that when the path 136 is presented at the UID 112, the path 136 is visible to the user.

A user of computing device 100 can cause UI module 120 to enter text into editing region 106A by providing input (eg, a tap and/or a non-tap gesture) at the location of UID 112 that displays the keys of gesture keyboard 106B. In response to such user input, computing device 100 may output one or more characters, strings, or strings of phrases, such as candidate words 130, in editing region 106A. In some examples, a word may be generally described as a string of one or more characters in a dictionary or dictionary (eg, a set of strings having a semantic meaning in a written or spoken language). In some examples, a "word" can refer to any group of one or more characters. For example, words can be out-of-vocabulary words or strings that are not included in a dictionary or dictionary, but are also used in written vocabulary to convey information from one person to another. For example, the words can include a name, a place, a slang, or any other vocabulary word or a string of unique formats, etc., including at least: a first portion of one or more characters and, in some examples, followed by one or more The second part of the character.

The UI module 120 can act as an intermediary between various components of the computing device 100 to make a determination based on the input detected by the UID 112 and generate an output presented by the UID 112. For example, the UI module 120 can receive a representation of the keyboard layout of the keys included in the gesture keyboard 106B as input from the keyboard module 122. In some examples, UI module 120 may determine that one or more of the positional components of the sequence of touch events are proximate to input at gesture keyboard 106B (eg, UI module 120 may determine that the location of one or more of the touch events corresponds to the presentation The area of the UID 112 of the gesture keyboard 106B). The UI module 120 can communicate the sequence of touch events along with the location of each of the UID 112 presentation keys as an output to the keyboard module 122.

In response to transmitting the touch event and the location of the key to the keyboard module 122, the UI module 120 can receive a candidate term (eg, a text string representing the candidate term 130) determined by the keyboard module 122 based on the sequence of touch events. The UI module 120 can update the user interface 114 to include candidate words 130 received from the keyboard module 122 within the editing region 106A. The UI module 120 can cause the UID 112 to present an updated user interface 114 in the editing region 106A that includes candidate words 130 that are rendered as graphical elements (eg, characters).

The keyboard module 122 of the computing device 100 can transmit a keyboard layout including a plurality of keys associated with one or more written languages or language systems (eg, Pinyin, English, Spanish, French, Arabic, etc.) as output to the UI module 120 (to incorporate the gesture keyboard 106B of the user interface 114). Keyboard module 122 can assign one or more characters or operations to each of a plurality of keys in a keyboard layout. For example, keyboard module 122 may generate a QWERTY keyboard layout including keys that represent characters used in a particular language or language system such as an English language or for typing pinyin. The QWERTY keyboard layout may also include keys that represent operations used in the typing language (eg, backspace, delete, spaces, carriage returns, etc.).

The keyboard module 122 can receive data from the UI module 120 that represents the sequence of touch events generated by the UI module 120 and the location of the UID 112 of the UID 112 that presents each of the keys of the gesture keyboard 106B. The keyboard module 122 can determine the selection of one or more keys based on the location of the keys and the sequence of touch events. The keyboard module 122 can determine a character string based on the selection, in which each character in the string corresponds to at least one of the selections. The keyboard module 122 can send data indicating the character string to the UI module 120 to include the candidate words 130 in the edit region 106A of the user interface 114.

Keyboard module 122 may rely on various models and algorithms (eg, spatial models, language models, etc.) to determine whether a sequence of touch events represents a selection of one or more keys and to determine a string based on the selection of the keys. For example, the keyboard module 122 can include a spatial model, a language model, and a stress model to determine which keys of the gesture keyboard 106B are being selected and which string is being entered with the selection with a certain degree of certainty.

Using such a spatial model, keyboard module 122 can compare the positional components (eg, coordinates) of one or more touch events in the sequence of touch events to the corresponding locations of one or more keys of gesture keyboard 106B and based on these comparisons To generate the probability that a selection of one or more keys occurs. For example, keyboard module 122 can perform a position component of each touch event in a sequence of touch events with a key position of a particular key of gesture keyboard 106B. Comparison. The location component of each touch event in the sequence may include a location of the UID 112 and the key location of the key in the gesture keyboard 106B (eg, the centroid of the key) may include different locations of the UID 112. The keyboard module 122 can determine an Euclidian distance between the two locations and generate a probability that the key is selected based on the Euclidean distance. Keyboard module 122 may associate a higher probability to a key that is less distant Euclidean distance from one or more touch events than a key that shares a larger Euclidean distance than one or more touch events. Based on the spatial model probabilities associated with each key, keyboard module 122 may aggregate the individual key selections with the highest spatial model probability into a sequence of time-ordered keys, after which keyboard module 122 may determine the sequence representation string for the key.

Using a language model and/or by accessing a dictionary, keyboard module 122 can modify the spatial model output to automatically correct (eg, spell check) or predict which string the user actually intends to enter when selecting a sequence of keys associated with the string. For example, the dictionary of computing device 100 can include a list of words within a written language vocabulary. Using the language model, keyboard module 122 can perform a lookup of the string generated by the spatial model in a dictionary to identify one or more candidate words or candidates that include at least some or all of the characters based on the selection of the key. String. The language model can determine a confidence score or probability that the string matches or corresponds to one or more words or candidate strings in the dictionary. The keyboard module 122 may output the closest matching candidate word as a "candidate string" for indicating the selection of the key instead of outputting the string generated by the spatial model.

The language model or dictionary may indicate that the candidate string is associated with an additional symbol style - the additional symbol style is a sequence of one or more additional symbols in the word. For example, a word from a language or language system represented by a candidate string may include one or more tone notes, phonetic symbols, etc. over certain letters of the word to indicate a particular pronunciation of the word. In some examples, the additional symbol pattern may have a single additional symbol or multiple additional symbols. In other examples, the additional symbol style may not have an additional symbol - that is, the additional symbol style may be a style without any additional symbols.

In some cases, a language model or dictionary can indicate candidate strings with at least An additional symbol style for an additional symbol is associated. In response to determining that the candidate string is associated with a single additional symbol pattern, keyboard module 122 may output an indication of the additional symbol pattern along with the candidate string such that UI module 120 uses UID 112 to display the candidate string including the indication of the additional symbol pattern Graphical indication.

Sometimes, the language model or dictionary of keyboard module 122 may return candidate strings associated with two or more additional symbol styles. For example, if a candidate string represents a word from a language or language system that has more than one meaning or more than one correct pronunciation, the language or language system can specify for a particular field by marking the word with a different additional symbol style. The correct meaning or pronunciation of the environment. For example, a string can include the letter 'u' as its second letter. In a language system such as Pinyin, the first utterance of the string may include a ‘`’ additional symbol above the letter 'u’ and the second utterance of the string may include a ‘–’ additional symbol above the letter 'u’. In response to determining that the candidate character string is associated with two or more additional symbol styles, the keyboard module 122 can analyze the gesture input to further discern which additional symbol style is included in the output to the UI module 120.

Using the stress model, keyboard module 122 can select a particular additional symbol pattern from two or more additional symbol styles based on the pressure information specified by the touch event associated with the gesture input. The pressure model may receive as an input an indication of the amount of pressure detected during reception of the gesture input, and based on the input, identify the style of the additional symbol as its output.

The pressure model can compare pressure information to a group of pressure thresholds or curves. The stress model can assign each threshold or curve from the group to a different additional symbol style. For example, in the context of pinyin, the pressure model can assign a constant pressure curve to a first additional symbol pattern that includes a constant tone additional symbol, and assign an increasing pressure curve to a second additional that includes an increasing tone additional symbol. a symbol pattern, assigning a decreasing and increasing pressure curve to a third additional symbol pattern including a decreasing and increasing intensive additional symbol, and assigning the decreasing pressure curve to a fourth including a decreasing tonal additional symbol Additional symbol styles.

The pressure model of keyboard module 122 may select a particular pressure threshold or curve that most closely resembles the pressure information associated with the gesture input. The keyboard module 122 can output an indication of the additional symbol pattern associated with a particular pressure threshold or curve to the UI module 120.

In the example of FIG. 1, computing device 100 can output a graphical keyboard that includes a plurality of keys for display. For example, keyboard module 122 can generate data including a representation of gesture keyboard 106B. The UI module 120 can generate the user interface 114 and include the gesture keyboard 106B in the user interface 114 based on data representing the gesture keyboard 106B. The UI module 120 can send information including instructions for displaying the user interface 114 at the UID 112 to the UID 112. The UID 112 can receive this information and cause the UID 112 to present a user interface 114 that includes an edit region 106A and a gesture keyboard 106B.

Computing device 100 can receive an indication of a gesture input selecting one or more keys of a graphical keyboard. The gesture input can be detected by a pressure sensitive input device (eg, UID 112) and the indication of the gesture input can include pressure information associated with the gesture input. For example, a user of computing device 100 can provide a second location that begins at a first location starting with UID 112 (eg, at a location where UID 112 of the 'M' key is displayed) and ends at a second location of UID 112 (eg, a continuous gesture input of the path 136 at the location of the UID 112 where the 'N' key is displayed, such that the gesture performed from the first location to the second location is detected by the UID 112 during the entire execution of the gesture . In the example shown in FIG. 1, the gesture can pass through a sequence of keys including 'M', 'J', 'U', 'Y', 'T', 'R', 'F', 'W', and 'Q' keys, followed by 'Q', 'W', 'F', 'R', 'T', 'Y', 'U 'Key, 'I', 'J', and 'N'.

When a gesture input through path 136 is provided, the user can apply a varying amount of force or amount of pressure at UID 112 to indicate which one or more additional symbols the user wishes to specify for inputting a particular string or word. For example, as envisioned by a white circle having the letters A through E, as in Figure 1, the user can provide a gesture at a different amount of pressure in different portions of the gesture to specify a particular addition that the computing device 100 will use when interpreting the input. Symbol number. The amount of pressure associated with the gesture input may decrease between portion A and portion B and increase between portion B and portion C. Furthermore, the amount of pressure can remain nearly constant between the portion D and the portion E (neither decreasing nor increasing).

As part of receiving an indication of the gesture input, the UI module 120 can generate a sequence of touch events based on the gesture. In some examples, UI module 120 may cause UID 112 to present a graphical indication of path 136 based on information received from UI module 120 regarding the gesture location detected by UID 112.

Computing device 100 can determine a candidate character string associated with two or more additional symbol patterns based at least in part on an indication of a gesture input, wherein at least one of the two or more additional symbol patterns includes at least one additional symbol . For example, keyboard module 122 may rely on pressure information associated with a sequence of touch events generated by UI module 120 as well as spatial models, language models, and/or other techniques to determine which keys are most likely to be selected and where the user is most likely to attempt The candidate character string entered is used as an input to the editing area 106A.

The keyboard module 122 can determine, based at least in part on the spatial model and the language model that the gesture input is most likely to represent a continuous gesture input for entering a word in the phonetic language system, the word being represented by the candidate character string m-u-q-i-n. The keyboard module 122 can further determine that the character string m-u-q-i-n is associated with two or more additional symbol styles, for example based on the Pinyin dictionary of the keyboard module 122. For example, the word muqin - in the absence of a specified tone - can have multiple meanings in pinyin: m-ǔ-q-ī-n means "mother", m-ù-q-í-n means "Xicin" and m-ù-q-ī-n mean "睦亲".

Computing device 100 can select a particular additional symbol pattern from two or more additional symbol patterns based on the pressure information. For example, using a stress model, keyboard module 122 can select between each of the potential additional symbol styles associated with candidate character strings m-u-q-i-n based on the pressure information specified by the touch event associated with the gesture input.

In the analysis of the gesture input between portion A and portion C, the pressure model of keyboard module 122 may determine that the pressure information associated with the portion of the gesture input corresponds to a decreasing and increasing pressure curve, and thus, corresponding The portion of the character string muqin input by the gesture between the portion A and the portion C is associated with the decreasing and increasing tone addition symbol. In the analysis of the gesture input between portion D and portion E, the pressure model of keyboard module 122 may determine that the pressure information associated with the portion of the gesture input corresponds to a constant pressure curve and, therefore, corresponds to portion D and The portion of the character string muqin of the gesture input between the parts E is associated with the decreasing and increasing tone addition symbol.

Since only the additional symbol pattern m-ǔ-q-ī-n associated with the candidate character string muqin has a decreasing and then increasing tone additional symbol followed by a constant tone additional symbol, the pressure model of the keyboard module 122 can be specifically appended The symbol style m-ǔ-q-ī-n is selected to correspond to the gesture input. The keyboard module 122 may output an indication of the candidate character string to the UI module 120 along with a particular additional symbol pattern selected based on the pressure information.

Computing device 100 can output a graphical indication of a candidate string for display, wherein the graphical representation of the candidate string includes an indication of a particular additional symbol pattern. For example, in response to receiving an indication of the candidate character string from the keyboard module 122 and the associated additional symbol style, the UI module 120 can cause the UID 112 to present the candidate word 130 as a graphical indication within the editing region 106A of the user interface 114, the candidate term 130 includes the letters of the string m-ǔ-q-ī-n and corresponding additional symbols.

Thus, unlike other computing devices that may not provide a simple or intuitive way for a user to specify additional symbols while providing continuous gesture input at the graphical keyboard, the techniques described herein allow the user to change the application during the gesture input process. The amount of pressure specifies which additional symbol is displayed when displaying a character string that has been determined to have two or more additional symbol styles according to the gesture input. Accordingly, the techniques of the present disclosure may improve the overall input speed and accuracy of the gesture keyboard by providing a way to simultaneously specify additional symbols when providing gesture input for entering words. Moreover, the techniques of the present disclosure can improve the overall gesture keyboard by reducing the likelihood of erroneous or ambiguous text entry Input speed and accuracy.

2 is a block diagram illustrating an example computing device configured to determine text using pressure information associated with gesture input at a gesture keyboard, in accordance with one or more aspects of the present disclosure. The computing device 100 of FIG. 2 is described below in the field of FIG. 2 illustrates only one particular example of computing device 100, and many other examples of computing device 100 may be used in other examples and may include a subset of components included in example computing device 100 or may include not illustrated The add-on shown in 2.

As shown in the example of FIG. 2, computing device 100 includes UID 112, one or more processors 202, one or more input devices 204, one or more communication units 206, one or more output devices 208, and one Or a plurality of storage devices 210. The storage device 210 of the computing device 100 also includes a UI module 120 and a keyboard module 222. The UI module 120 includes all of the functions of the UI module 120 of FIG. The keyboard module 222 includes a spatial language model module 224 ("SLM Module 224") and a pressure module 226. Communication channel 212 can interconnect

components

112, 120, 222, 202, 204, 206, 208, 210, 224, and 226 for inter-component communication (physically, communicatively, and/or operatively communicating). In some examples, communication channel 212 can include a system bus, a network connection, an inter-process communication data structure, or any other method for transmitting data.

One or more input devices 204 of computing device 100 can receive input. Examples of inputs are tactile input, audio input, and video input. In one example, input device 204 of computing device 100 includes a presence sensitive input device (eg, a touch sensitive screen, presence sensitive display), a mouse, a keyboard, a voice response system, a video camera, a microphone, or for detecting from a person or machine. Enter any other type of device.

One or more output devices 208 of computing device 100 can generate an output. Examples of outputs are haptic output, audio output, and video output. In one example, output device 208 of computing device 100 includes a presence sensitive display, a sound card, a video graphics adapter card, a speaker, a cathode ray tube (CRT) monitor, a liquid crystal display (LCD), or Any other type of device that produces output to a person or machine.

One or more communication units 206 of computing device 100 can communicate with external devices via the one or more networks by transmitting and/or receiving network signals over one or more networks. For example, computing device 100 can use communication unit 206 to transmit and/or receive radio signals over a radio network, such as a cellular radio network. Likewise, communication unit 206 can transmit and/or receive satellite signals over a satellite network, such as a GPS network. Examples of communication unit 206 include a network interface card (eg, such as an Ethernet card), an optical transceiver, a radio frequency transceiver, a GPS receiver, or any other type of device capable of transmitting and/or receiving information. Other examples of communication unit 206 may include a cellular found in a mobile device,

GPS, 3G, 4G, LTE, and

Radio and Universal Serial Bus (USB) controllers.

In some examples, UID 112 of computing device 100 may include the functionality of input device 204 and/or output device 208. In the example of FIG. 2, UID 112 is primarily described as a pressure sensitive input device and a pressure sensitive display. In some examples, UID 112 is also a presence sensitive input device and can detect objects at and/or near the presence of sensitive input devices. As an example range, there are sensitive input devices that can detect an object, such as a finger or stylus located within 2 inches or more of the presence of a sensitive input device. The presence of the sensitive input device can determine the location of the detected object (eg, [x, y] coordinates) where the sensitive input device is present. In another example range, the presence of a sensitive input device can detect objects within 6 inches or more of the presence of the sensitive input device and other ranges are also possible. The presence sensitive input device may use capacitive, inductive, and/or optical recognition techniques to determine the location of the input device selected by the user's finger. In some examples, there is a sensitive input device that uses the haptic, audio, or video stimuli described with respect to output device 208 to provide an output to the user. In the example of FIG. 2, UID 112 presents a user interface at UID 112 (such as user interface 114 of FIG. 1).

Although illustrated as an internal component of computing device 100, UID 112 also represents an external component that shares a data path for transmitting and/or receiving input and output with computing device 100. For example, in one example, UID 112 represents a built-in component of computing device 100 that is located within and physically connected to an external enclosure of computing device 100 (eg, a screen on a mobile phone). In another example, UID 112 represents an external component of computing device 100 that is external to and physically separate from the enclosure of computing device 100 (eg, a monitor, projection that shares wireless and/or wired data paths with the tablet computer) Instrument, etc.).

One or more storage devices 210 within computing device 100 may store information for processing during operation of computing device 100. In some examples, storage device 210 is a temporary storage, meaning that the primary purpose of storage device 210 is not long term storage. The storage device 210 on the computing device 100 can be configured as a volatile memory for short term storage of information and thus does not retain stored content if closed. Examples of volatile memory include random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), and other forms of volatile memory known in the art.

In some examples, storage device 210 also includes one or more computer readable storage media. Storage device 210 can be configured to store a greater amount of information than volatile memory. The storage device 210 can be further configured as a non-volatile memory space for long term storage of information and retains information after a power on/off cycle. Examples of non-volatile memory include magnetic hard disks, optical disks, floppy disks, flash memory, or electrically programmable memory (EPROM) or electrically erasable programmable (EEPROM) memories. Storage device 210 may store program instructions and/or data associated with UI module 120, keyboard module 222, SLM module 224, and pressure module 226.

One or more processors 202 can implement functions and/or execute instructions within computing device 100. For example, processor 202 on computing device 100 can receive and execute instructions stored by storage device 210 that perform the functions of UI module 120, keyboard module 222, SLM module 224, and pressure module 226. These instructions, when executed by processor 202, may cause computing device 100 to store information within storage device 210 during program execution. Processor 202 can execute the instructions of

modules

120, 222, 224, and 226 such that UID 112 is A user interface, such as user interface 114 of FIG. 1, is displayed at UID 112. That is,

modules

120, 222, 224, and 226 can be operated by processor 202 to perform various actions, including receiving an indication of a gesture at a location of UID 112 and causing UID 112 to present a user interface at UID 112.

Keyboard module 222 is one example of keyboard module 122 of FIG. The keyboard module 222 includes an SLM module 224 for determining candidate character strings based on gesture inputs detected at the UID 112, and a pressure module 226 for selecting additional symbol patterns for application to the SLM module 224. Determined candidate string.

SLM module 224 represents the combined spatial and linguistic model of keyboard module 222. The SLM module 224 can receive as input one or more touch events generated in response to the gesture detected at the UID 112. Based on the one or more touch events, the SLM module 224 can determine a sequence of keys of the graphical keyboard that the gesture is most likely to select and determine a string based on the sequence. The SLM module 224 can perform spell checking of strings or other auto-correction techniques to determine one or more candidate strings (eg, words or phrases from a language or language system) that have the highest probability of The intended word or phrase selected by the gesture.

The SLM module 224 can determine that the candidate string is associated with an additional symbol pattern. For example, the SLM module 224 can determine that a letter of the candidate string may include one or more tone notes, phonetic symbols, etc. to indicate a particular pronunciation of the particular letter when the particular string or word is pronounced. In some examples, the additional symbol pattern may have a single additional symbol (eg, an additional symbol associated with one letter of the string) or multiple additional symbols (eg, each of two or more letters in the string) The letter is associated with the corresponding additional symbol). In other examples, the additional symbol pattern may not have an additional symbol - ie, the SLM module 224 may determine a candidate string with additional symbols in which all letters of the candidate string are not subject to any additional symbols and do not have any additional symbols Style associated. In addition to the indication of any additional symbol styles associated with the candidate character string, the SLM module 224 can output an indication (eg, data) indicative of the candidate character string determined from the gesture input.

In some examples, SLM module 224 can determine that the candidate character string is associated with a single additional symbol pattern that includes at least one additional symbol. In response to determining that the candidate string is associated with a single additional symbol pattern, keyboard module 222 can provide an indication of the additional symbol pattern as its output along with the candidate string. In this manner, any module or component of computing device 100 that receives an indication of the candidate character string as output from keyboard module 222 also receives an indication of the additional symbol pattern associated with the candidate character string.

In other examples, SLM module 224 can determine candidate strings associated with two or more additional symbol styles. For example, as shown in FIG. 1, the SLM module 224 can determine that the candidate character string for pinyin is m-u-q-i-n, which can take different meanings in pinyin depending on its pronunciation. The SLM module 224 can determine that the candidate string muqin is associated with at least three different additional symbol styles and request the pressure module 226 to determine which of the at least three different additional symbol styles is most likely to be intended by the user and the keyboard module 122 Therefore, which additional symbol pattern should be included in the output along with the candidate string.

The pressure module 226 can infer whether one or more additional symbols need to be added to the candidate character string determined by the SLM module 224 based on the obtained pressure information regarding the gesture input. For example, the pressure module 226 can select a particular additional symbol pattern from two or more additional symbol styles based on pressure information specified by a touch event associated with the gesture input. The pressure module 226 can receive an indication (eg, data) of the amount of pressure detected by the UID 112 during reception of the gesture input from the SLM module 224 as an input, and based on the input, identify whether to be added or not added to the SLM The pattern of the additional symbols of the candidate string determined by module 224 is taken as its output.

The pressure module 226 can compare the pressure information to a group of pressure thresholds, templates, or curves, and the pressure module 226 assigns the group to potential additional symbols or additional symbol styles that can be added or not added to the candidate string. . For example, in the context of pinyin, the pressure module 226 can: assign a constant pressure curve to a first additional symbol pattern that includes a constant tone-attached symbol, and assign an increasing pressure curve to include an increasing tone. a second additional symbol pattern of the sign, a decreasing and increasing pressure curve assigned to the third additional symbol pattern including the decreasing and increasing intensive additional symbols, and assigning the decreasing pressure curve to include decreasing The fourth additional symbol style for the tone attached symbol. In the context of other languages or systems, such as Spanish, the pressure module 226 can assign different pressure curves to other additional symbol styles, such as phonetic symbols, tilde symbols, and the like.

The pressure module 226 can assign a pressure curve to an additional symbol or an additional symbol pattern that has a shape similar to the shape of the additional symbol when plotted on the time axis. For example, the pressure module 226 can assign an increasing pressure curve to a diacritic symbol (eg, an upwardly directed line segment) and can assign an increasing-decreasing-increasing pressure curve to the sigma symbol "~". The pressure module 226 can select a particular pressure threshold or curve that most closely resembles the pressure information associated with the gesture input and output an indication to the UI module 120 of the additional symbol pattern associated with the particular pressure threshold or curve.

In some examples, the pressure module 226 can select a particular additional symbol or additional symbolic style by analyzing pressure information that is only associated with a portion of the gesture, and in other examples, the pressure module 226 can analyze the associated portion of the gesture. Pressure information to select additional symbols. In other words, the pressure module 226 can determine whether a particular letter is to have a particular additional symbol based on the amount of pressure associated with the selection of a particular letter in the candidate string. And in other examples, the pressure module 226 can determine whether a particular letter in the candidate string has a particular additional symbol based on the amount of pressure associated with the selection of all or more of the letters in the candidate string.

For example, the pressure module 226 can select a particular additional symbol pattern from two or more additional symbol styles associated with the candidate character string based on pressure information associated with the portion of the gesture input for which the single key of the graphical keyboard is selected. Accordingly, the graphical indication that keyboard module 222 causes UI module 120 to output for display with the candidate character string can include an indication of a particular additional symbol pattern that is at least partially located above the character associated with the single key.

The candidate string can include an additional symbol style with more than one additional symbol In the event that the pressure module 226 can continue to analyze the pressure information associated with the subsequent portion of the gesture input to further include based on whether the subsequent portion of the gesture input includes: constant pressure, increasing pressure, decreasing and increasing Pressure, or decreasing pressure, to select a particular additional symbol style. For example, the pressure module 226 can select a particular additional symbol pattern from two or more additional symbol styles associated with the candidate string based on pressure information associated with the initial portion of the gesture input and the subsequent portion of the gesture input, the candidate The string includes at least two additional symbols - a first additional symbol that matches the pressure information associated with the initial portion and a second additional symbol that matches the pressure information associated with the subsequent portion.

As another example, the pressure module 226 can select a particular additional symbol style from two or more additional symbol styles associated with the candidate character string based on pressure information associated with selecting a portion of the gesture input of the plurality of keys of the graphical keyboard. . In such a case, the graphical representation of the keyboard module 222 causing the UI module 120 to output for display with the candidate character string can include: a particular addition at least partially above the character associated with a single key from the plurality of keys An indication of the symbol style.

The pressure module 226 can analyze the pressure information associated with the gesture input in a number of ways to map the pressure information to a particular additional symbol or additional symbol pattern. In some examples, pressure module 226 identifies a change in pressure to determine if the pressure information indicates a user's selection of an additional symbol. For example, the pressure module 226 can receive pressure information associated with a particular gesture and determine an amount of pressure change between the first portion of the gesture input and the second portion of the gesture input. The pressure module 226 can select a particular additional symbol pattern from two or more additional symbol styles based on the amount of pressure change.

For example, again in the context of pinyin, in response to determining that there is no or little change in pressure between the two portions of the gesture, pressure module 226 can assign a constant pressure curve to the first additional symbol that includes a constant tonal additional symbol. style. In response to identifying an increase in pressure between the two portions of the gesture, the pressure module 226 can assign the incremental pressure curve to a second additional symbol pattern that includes an increasing tone addition symbol. In response to recognizing an increase in pressure between the two portions of the gesture, the pressure module 226 can be gradually decreasing and increasing pressure The curve is assigned to a third additional symbol pattern that includes a decreasing and then increasing tone addition symbol. In response to identifying a decrease in pressure between the two portions of the gesture, the pressure module 226 can assign the decreasing pressure curve to a fourth additional symbol pattern that includes the decreasing tonal additional symbol. In the context of other languages or systems, such as Spanish, the pressure module 226 can assign different pressure curves to other additional symbol styles, such as phonetic symbols, tilde symbols, and the like.

3 is a block diagram illustrating an example computing device 300 configured to select additional symbol patterns based on pressure information associated with gesture inputs detected at a gesture keyboard, in accordance with one or more techniques of the present disclosure. Computing device 300 outputs graphical content for display at the remote device. In general, graphical content may include any visual information that may be output for display, such as text, images, groups of moving images, and the like.

The example shown in FIG. 3 includes computing device 300, presence sensitive display 301, communication unit 310, projector 320, projection screen 322, tablet device 326, and visual display device 330. Although shown as independent computing device 100 in FIGS. 1 and 2 for purposes of example, computing devices such as computing device 100 and/or computing device 300 may generally be referred to as including a processor or for executing software instructions. Any component or system of other suitable computing environment, and for example, does not need to include a presence sensitive display.

As shown in the example of FIG. 3, computing device 300 can be a processor that includes the functionality described with respect to processor 202 in FIG. In such an example, computing device 300 can be operatively coupled to presence sensitive display 301 via communication channel 303A, which can be a system bus or other suitable connection. Computing device 300 can also be operatively coupled to communication unit 310, described further below, via communication channel 303B, which can also be a system bus or other suitable connection. Although shown separately as an example in FIG. 3, computing device 300 can be operatively coupled to presence sensitive display 301 and communication unit 310 by any number of one or more communication channels.

In other examples, such as previously illustrated by computing device 100 in FIGS. 1-2, computing device 300 can be a portable device or a mobile device, such as a mobile phone (including a smart phone), a laptop, or the like. In some examples, computing device 100 can be a desktop computer, a tablet computer, a smart television platform, a camera, a personal digital assistant (PDA), a server, a host, and the like.

Similar to one example of UID 112 as shown in FIGS. 1 and 2, pressure sensitive display 301 can include display device 303 and pressure sensitive input device 305. For example, display device 303 can receive data from computing device 300 and display graphical content. In some examples, presence sensitive input device 305 can use capacitance recognition techniques, inductive recognition techniques, and/or optical recognition techniques to determine one or more user inputs at pressure sensitive display 301 (eg, continuous gestures, multi-touch Gestures, single touch gestures, etc.), and use communication channel 303A to send such user input indications to computing device 300. In some examples, the pressure sensitive input device 305 can be physically placed over the display device 303 such that when the user places the input unit over the graphical element displayed by the display device 303, the location of the pressure sensitive input device 305 corresponds to The position of the display device 303 displaying the graphic elements.

As shown in FIG. 3, computing device 300 can also include and/or be operatively coupled to communication unit 310. Communication unit 310 may include the functionality of communication unit 206 depicted in FIG. Examples of communication unit 310 may include a network interface card, an Ethernet card, an optical transceiver, a radio frequency transceiver, or any other type of device capable of transmitting and receiving information. Other examples of such communication units may include Bluetooth, 3G, 4G, LTE, and Wi-Fi radios, Universal Serial Bus (USB) interfaces, and the like. Computing device 300 may also include and/or be operatively coupled to one or more other devices, such as input devices, output devices, memory, storage devices, etc., for purposes of brevity and illustration, not shown in FIG. The one or more other devices.

FIG. 3 also illustrates projector 320 and projection screen 322. Other such examples of projection devices may include an electronic whiteboard, a holographic display device, and any of the means for displaying graphical content. What other suitable equipment. Projector 320 and projector screen 322 may include one or more communication units that enable respective devices to communicate with computing device 300. In some examples, one or more communication units can support communication between projector 320 and projection screen 322. Projector 320 can receive data from computing device 300 that includes graphical content. In response to receiving the data, projector 320 can project graphical content onto projection screen 322. In some examples, projector 320 may use optical recognition techniques or other suitable techniques to determine one or more user inputs (eg, continuous gestures, multi-touch gestures, single touch gestures, etc.) at the projection screen, and Such an indication of user input is sent to computing device 300 using one or more communication units.

In some examples, projection screen 322 can include presence sensitive display 324. The presence-sensitive display 324 can include a subset of the functionality of the UI device 112 described in this disclosure or all of its functionality. In some examples, presence sensitive display 324 can include additional functionality. Projection screen 322 (eg, an electronic whiteboard) can receive data from computing device 300 and display graphical content. In some examples, presence sensitive input display 324 can use capacitance recognition techniques, inductive recognition techniques, and/or optical recognition techniques to determine one or more user inputs at projection screen 322 (eg, continuous gestures, multi-touch gestures) A single touch gesture, etc., and one or more communication units are used to send such an indication of user input to computing device 300.

FIG. 3 also illustrates tablet device 326 and visual display device 330. Both tablet device 326 and visual display device 330 can include computing power and connectivity capabilities. Examples of tablet device 326 may include an e-reader device, a convertible notebook device, a hybrid tablet device, and the like. Examples of visual display device 330 may include televisions, computer monitors, and the like. As shown in FIG. 3, tablet device 326 can include presence sensitive display 328. Visual display device 330 can include presence sensitive display 332. The presence-

sensitive display

328, 332 may include a subset of the functionality of the UI device 112 described in this disclosure or all of its functionality. In some examples, presence

sensitive displays

328, 332 may include additional functionality. In any event, for example, presence sensitive display 332 can receive data from computing device 300 and display graphical content. In some examples, presence sensitive input device 332 can use capacitive knowledge Other techniques, inductive recognition techniques, and/or optical recognition techniques to determine one or more user inputs (eg, continuous gestures, multi-touch gestures, single touch gestures, etc.) at the projection screen, and using one or more The communication unit sends such an indication of user input to computing device 300.

The presence

sensitive display

328, 332 can include a pressure sensitive function that enables the pressure sensitive display to determine pressure information or force information corresponding to a user input object (eg, a finger) that is in contact with the

sensitive display

328, 332. For example, the presence sensitive display 332 can be configured to detect an amount of force applied by the user input object to the presence sensitive display 332.

As noted above, in some examples, computing device 300 can output graphical content for display at pressure sensitive display 301 that is coupled to computing device 300 via a system bus or other suitable communication channel. Computing device 300 can also output graphical content for display at one or more remote devices, such as projector 320, projection screen 322, tablet device 326, and visual display device 330. For example, computing device 300 can execute one or more instructions to generate and/or modify graphical content in accordance with the techniques of the present disclosure. Computing device 300 can output data including graphical content to a communication unit of computing device 300, such as communication unit 310. Communication unit 310 can transmit data to one or more of remote devices such as projector 320, projection screen 322, tablet device 326, and/or visual display device 330. In this manner, computing device 300 can output graphical content for display at one or more of the remote devices. In some examples, one or more of the remote devices can output graphical content at a presence sensitive display, the presence sensitive display being included in a respective remote device and/or operatively coupled to the respective remote device.

In some examples, computing device 300 may not output graphical content at pressure sensitive display 301 that is operatively coupled to computing device 300. In other examples, computing device 300 can output graphical content for display at both pressure sensitive display 301 coupled to computing device 300 via communication channel 303A and at one or more remote devices. In such an example, graphical content can be displayed substantially simultaneously at each respective device. For example, communication delays that may be sent to remote devices by data including graphical content introduce some delay. In some examples, graphical content generated by computing device 300 and output for display at pressure sensitive display 301 can be displayed differently than graphical content output for display at one or more remote devices.

Computing device 300 can transmit and receive data using any suitable communication technology. For example, computing device 300 can be operatively coupled to external network 314 by using network link 312A. Each of the remote devices illustrated in FIG. 3 can be operatively coupled to network to external network 304 by one of

respective network links

312B, 312C, and 312D. The external network 304 can include a network hub, a network switch, a network router, etc., the network hub, the network switch, the network router, etc., being operatively coupled to each other such that between the computing device 300 and the remote device illustrated in FIG. Provide information exchange. In some examples, network links 312A through 312D may be Ethernet, ATM, or other network connections. Such connections may be wireless and/or wired.

In some examples, direct device communication 318 can be used to operably couple computing device 300 to one or more of the remote devices included in FIG. Direct device communication 318 can include communication using wired or wireless communication by which computing device 300 can transmit and receive data directly with the remote device. That is, in some examples of direct device communication 318, the data may not be forwarded by one or more additional devices before the remote device receives the data transmitted by computing device 300, and vice versa. Examples of direct device communication 318 may include Bluetooth, near field communication, universal serial bus, Wi-Fi, infrared, and the like. One or more of the remote devices illustrated in FIG. 3 may be operatively coupled to computing device 300 via communication links 316A-316D. In some examples, communication links 316A through 316D may be connections using Bluetooth, near field communication, universal serial bus, infrared, and the like. Such connections may be wireless and/or wired.

The external network 304 can be used to operatively couple the computing device 300 to the visual display device 330 in accordance with the techniques of the present disclosure. Computing device 300 can output graphics or gesture keys The disc is for display at the presence sensitive display 332. For example, computing device 300 can transmit data including a representation of gesture keyboard 306B to communication unit 310. Communication unit 310 can use external network 304 to transmit data including the representation of gesture keyboard 306B to visual display device 330. In response to using the external network 304 to receive data, the visual display device 330 can cause the presence sensitive display 332 to output a gesture keyboard 306B that includes a plurality of keys.

A first group of keys of the keyboard is selected in response to the user performing a gesture at the pressure sensitive display 332, such as "muqin" (<M key > followed by at least <U key>, <Q key>, <I key>, and The <N key> and potentially other keys), the visual display device 330 can use the external network 304 to send an indication of the gesture to the computing device 300. Communication unit 310 can receive an indication of the gesture and send the indication to computing device 300.

Upon receiving an indication of the gesture, computing device 300 can determine a selection of a key for graphical keyboard 106B. For example, computing device 300 can determine a combined selection of keys based on an indication of the first gesture and the second gesture received via communication unit 310. Computing device 300 can determine candidate words based on the combined selection of keys. The candidate term can be associated with two or more additional symbol styles.

Computing device 300 can use communication unit 110 and external network 304 to output data to visual display device 330 that indicates to candidate presence display 332 candidate words and associated additional symbols that are inferred from the obtained pressure information about the gesture. Style - to cause visual display device 330 to output graphical indications of candidate words and additional symbol styles for display at presence sensitive display 332. For example, in response to receiving pressure information associated with the gesture that is gradually decreasing and increasing during selection of the "U-key", and further responsive to receiving the selection of the "I-key" associated with the gesture Maintaining pressure information for near constant pressure, display device 330 can cause presence sensitive display 332 to present a pinyin "mǔqīn" graphical indication.

4A is a diagram illustrating an example computing setup for selecting an additional symbol pattern based on pressure information associated with gesture input, in accordance with one or more aspects of the present disclosure. A map of the change in pressure during the detection of different gesture inputs made at the gesture keyboard. 4B-4E are exemplary computing devices configured to select additional symbol patterns based on pressure information associated with gesture input, in response to gesture input associated with FIG. 4A, in accordance with one or more aspects of the present disclosure. An example graphical indication is displayed. 4A-4E are described below in the context of computing device 100 of FIGS. 1 and 2.

4A shows pressure map 401A to pressure map 401D (collectively referred to as "pressure map 401") as having a change in pressure between pressure levels p1 and p2 and between times t1 and t3. The pressure module 226 of the keyboard module 222 can receive a sequence of touch events associated with gestures at the graphical keyboard having a time component and a magnitude component that can be rendered in graphical form and represented as the graph shown in FIG. 4A. Pressure information.

In some examples, each of the pressure maps 401 can be associated with a different gesture performed at a graphical keyboard, such as the graphical keyboard 106B. In other examples, any two or more of the pressure maps 401 can be associated with a single gesture performed at the graphical keyboard. That is, the pressure map 401 can be associated with some or all of the gestures.

Figures 4B-4E illustrate graphical indications 403A through 403D (collectively referred to as "graphic indications 403"), each including a respective indication of one of the additional symbol patterns 405A through 405D (collectively referred to as "additional symbol patterns 405"). As an example, each of the additional symbol styles corresponds to one of four different pinyin tones of the pinyin of the language system. Each of the graphical indications 403 corresponds to a different one of the pressure maps 401A through 401D. For example, the graphical indication 403A of Figure 4B corresponds to the pressure map 401A of Figure 4A. The graphical indication 403B of Figure 4C corresponds to the pressure map 401B of Figure 4A. The graphical indication 403C of Figure 4D corresponds to the pressure map 401C of Figure 4A. The graphical indication 403D of Figure 4E corresponds to the pressure map 401D of Figure 4A.

In operation, based on the pressure information represented in the graph of FIG. 4A, the pressure module 226 can include a portion based on the gesture input whether: constant pressure, increasing pressure, decreasing pressure, increasing pressure, decreasing Pressure to choose a specific additional symbol style, choose and wait Select a specific additional symbol style associated with a string or candidate. For example, in response to determining that a portion of the gesture input includes a constant pressure as shown in plot 401A, pressure module 226 may select an additional symbol pattern 405A that includes a constant Pinyin tones additional symbol. In response to determining that a portion of the gesture input includes increasing pressure, the pressure module 226 can select an additional symbol pattern 405B that includes the upward Pinyin tones additional symbol. In response to determining that a portion of the gesture input includes a decreasing and increasing pressure, the pressure module 226 can select an additional symbol pattern 405C that includes a pinyin tone additional symbol that is downward and upward. In response to determining that a portion of the gesture input includes decreasing pressure, the pressure module 226 can select an additional symbol pattern 405D that includes a downward Pinyin tones additional symbol.

After selecting a particular additional symbol style, the pressure module 226 can cause the UI module 120 to output an indication of the selected additional symbol style for display with the associated candidate character string or graphical indication of the word. For example, UI module 120 can receive a command or instruction from keyboard module 222 for displaying graphical indication 403A including additional symbol pattern 405A in response to determining that a portion of the gesture input includes a constant pressure as shown by plot 401A. The UI module 120 can receive commands or instructions from the keyboard module 222 for displaying the graphical indication 403B including the additional symbol pattern 405B in response to determining that a portion of the gesture input includes increasing pressure as shown by the plot 401B. The UI module 120 can receive commands or instructions from the keyboard module 222 for displaying the graphical indication 403C including the additional symbol pattern 405C in response to determining that a portion of the gesture input includes a decreasing and increasing pressure as shown by the plot 401C. The UI module 120 can receive commands or instructions from the keyboard module 222 for displaying the graphical indication 403D including the additional symbol pattern 405D in response to determining that a portion of the gesture input includes decreasing pressure as shown by the drawing 401D.

5 is a flow diagram illustrating example operations performed by an example computing device configured to select additional symbols based on pressure information associated with gesture inputs detected at a gesture keyboard, in accordance with one or more aspects of the present disclosure. . Operation 500 of FIG. 5 may be performed by one or more processors of a computing device, such as computing device 100 illustrated in FIGS. 1 and 2. For purposes of illustration only, FIG. 5 is described below within the field of computing device 100 of FIGS. 1 and 2.

FIG. 5 illustrates that computing device 100 can output a gesture keyboard (502) that includes a plurality of keys. For example, the UI module 120 of the computing device 100 can cause the UID 112 to present a graphical user interface 114 that includes a gesture keyboard 106B having a plurality of keys.

Computing device 100 can receive an indication of a gesture input selecting one or more keys of the graphical keyboard (504). For example, a user of computing device 100 can draw a gesture by touching the input surface of UID 112 to select a key of graphical keyboard 106B at graphical keyboard 106B that is associated with the letter spelling the word "muqin." While the user is providing a gesture at the UID 112, the UI module 120 and the keyboard module 122 can receive data regarding the input as an indication of the gesture from the UID 112, the indication of the gesture including the pressure detected during each portion of the gesture Information on the amount or amount of force.

Computing device 100 can determine candidate character strings associated with two or more additional symbols based on the gesture input (506). For example, the SLM module 224 of the keyboard module 122 can determine that the candidate character string "muqin" in the phonetic language system is associated with a plurality of different additional symbol patterns of one or more additional symbols.

Computing device 100 can select a particular additional symbol pattern from two or more additional symbol patterns based on the pressure information associated with the gesture input (508). For example, the pressure module 226 can receive an indication of a candidate character string determined from the gesture input and analyze the pressure information associated with the gesture. The pressure module 226 can match portions of the pressure information to different pressure curves that have been assigned to different additional symbols and different additional symbol patterns. In response to identifying the closest matching pressure curve, the pressure module 226 can output an indication of the corresponding additional symbol pattern.

Computing device 100 can output a graphical indication of the candidate character string including the indication of the particular additional symbol pattern (510). For example, UI module 120 can receive instructions from keyboard module 222 for presenting text "muqin" as pinyin by a particular additional symbol pattern that includes matching gesture input. For example, the pressure applied during gesture input can cause UID 112 Depending on the pressure module 226 determining which of the pressure profiles associated with each gesture input more closely matches the applied pressure received during the gesture input to present: a graphical indication of the pinyin mǔqīn of the "mother", The graphic indication of the pinyin mùqín of the "xylophone" or the graphic indication of the pinyin mùqīn of "the lyrics".

Clause 1. A method comprising: outputting, by a computing device, a graphical keyboard for display; receiving, by the computing device, an indication of a gesture input selecting one or more keys of the graphical keyboard, wherein the gesture input is The indication includes pressure information associated with the gesture input; the candidate string is determined by the computing device based at least in part on the indication of the gesture, wherein the candidate string is associated with two or more additional A symbol pattern is associated, wherein at least one of the two or more additional symbol patterns includes at least one additional symbol; from the two or more additionals by the computing device based on the pressure information The symbol pattern selects a particular additional symbol pattern; and the graphical indication of the candidate character string is output by the computing device for display, wherein the graphical indication of the candidate character string includes an indication of the particular additional symbol pattern.

The method of clause 1, wherein the at least one of the at least one additional symbol pattern of the two or more additional symbol patterns indicates at least one of the four pinyin tones tone.

The method of any one of clauses 1 to 2, wherein the selecting the particular additional symbol pattern comprises: based on whether a portion of the gesture input comprises: a constant pressure, an increasing pressure, a decreasing The increased pressure, or decreasing pressure, selects the particular additional symbol pattern.

The method of clause 3, wherein the selecting the particular additional symbol pattern comprises: selecting, by the computing device, to include a constant tone additional symbol in response to determining that the portion of the gesture input comprises a constant pressure a first additional symbol pattern; in response to determining that the portion of the gesture input includes increasing pressure, a second additional symbol pattern including an upward tone addition symbol is selected by the computing device; responsive to determining the hand The portion of the potential input includes a decreasing and increasing pressure, the computing device selecting a third additional symbol pattern including a downwardly-upward tone-added symbol; and responsive to determining that the portion of the gesture input includes The decreasing pressure is selected by the computing device to include a fourth additional symbol pattern of downward tonal additional symbols.

Clause 5. The method of any of clauses 3-4, wherein the portion of the gesture input is a first portion, the method further comprising: further determining whether the second portion of the gesture input comprises: constant The pressure, increasing pressure, decreasing pressure, or decreasing pressure selects the particular additional symbol pattern.

The method of any one of clauses 1 to 5, wherein the selecting the particular additional symbol pattern from the two or more additional symbol styles comprises determining, by the computing device, the gesture input a portion of the amount of pressure change between the portion and the second portion of the gesture input; and selecting, by the computing device, the particular additional symbol pattern from the two or more additional symbol patterns based on the amount of pressure change.

The method of any one of clauses 1 to 6, wherein: the pressure information is associated with a portion of the gesture input selecting a single key of the graphical keyboard; and the said candidate string The graphical indication includes an indication of the particular additional symbol pattern located at least partially above a character associated with the single key.

Clause 8. The method of any of clauses 1-7, wherein: the pressure information is associated with a portion of the gesture input selecting a plurality of keys of the graphical keyboard; and the candidate string The graphical indication includes an indication of the particular additional symbol pattern located at least partially above a character associated with a single key from the plurality of keys.

Clause 9. A computing device comprising: at least one processor; and at least one module operable by the at least one processor to: output a graphical keyboard for display; receive selection of the graphical keyboard An indication of a gesture input of one or more keys; determining a candidate string based at least in part on the indication of the gesture input, Wherein the candidate character string is associated with two or more additional symbol patterns, wherein at least one of the two or more additional symbol patterns includes at least one additional symbol; based on inputting with the gesture The indicating associated pressure information to select a particular additional symbol pattern from the two or more additional symbol styles; and outputting a graphical indication of the candidate string for display, wherein the candidate string The graphical indication includes an indication of the particular additional symbol pattern.

The computing device of clause 9, wherein the at least one of the at least one of the two or more additional symbol patterns indicates at least one of the four pinyin tones Pinyin tones.

The computing device of any of clauses 9-10, wherein: the at least one module is further operative by the at least one processor to determine whether a portion of the gesture input comprises: constant pressure, gradual The increased additional pressure, decreasing and increasing pressure, or decreasing pressure selects the particular additional symbol pattern.

The computing device of any one of clauses 9-11, wherein the at least one module is further operative by the at least one processor to select the particular additional symbol pattern by at least the following: determining The amount of pressure change between the first portion of the gesture input and the second portion of the gesture input; and selecting the particular additional symbol pattern from the two or more additional symbol patterns based on the amount of pressure change.

The computing device of any of clauses 9-12, wherein: the pressure information is associated with a portion of the gesture input selecting a single key of the graphical keyboard; and the candidate string The graphical indication includes an indication of the particular additional symbol pattern located at least partially above a character associated with the single key.

The computing device of any of clauses 9-13, wherein: the pressure information is associated with a portion of the gesture input selecting a plurality of keys of the graphical keyboard; and the candidate string The graphical indication includes at least partially located and An indication of the particular additional symbol above a character associated with a single key of the plurality of keys.

Clause 15. A computer readable storage medium encoded with instructions that, when executed, cause at least one processor of a computing device to: output a graphical keyboard for display; receive one or more selected to select the graphical keyboard An indication of a gesture input of a key, wherein the indication of the gesture input includes pressure information associated with the gesture input; determining a candidate character string based at least in part on the indication of the gesture input, wherein The candidate string is associated with two or more additional symbol patterns, wherein at least one of the two or more additional symbol patterns includes at least one additional symbol; based on the pressure information from the two One or more additional symbol patterns select a particular additional symbol pattern; and output a graphical indication of the candidate string for display, wherein the graphical representation of the candidate string includes an indication of the particular additional symbol pattern.

The computer readable storage medium of clause 15, wherein the at least one of the at least one of the two or more additional symbol patterns indicates the four pinyin tones At least one pinyin tone.

The computer readable storage medium of any one of clauses 15-16, wherein the instructions, when executed, further cause the at least one processor to select the particular additional symbol by at least: Whether a portion of the gesture input includes: a constant pressure, an increasing pressure, a decreasing and increasing pressure, or a decreasing pressure to select the particular additional symbol pattern.

The computer readable storage medium of any one of clauses 15-17, wherein the instructions, when executed, further cause the at least one processor to operate from the two or more at least by An additional symbol selecting the particular additional symbol: the computing device determines an amount of pressure change between the first portion of the gesture input and the second portion of the gesture input; and based on the pressure change by the computing device The particular additional symbol pattern is selected from the two or more additional symbol styles.

The computer readable storage medium of any of clauses 15-18, wherein: the pressure information is associated with a portion of the gesture input selecting a single key of the graphical keyboard; and the candidate character The graphical representation of the string includes an indication of the particular additional symbol pattern located at least partially above a character associated with the single key.

The computer readable storage medium of any of clauses 15-19, wherein: the pressure information is associated with a portion of the gesture input selecting a plurality of keys of the graphical keyboard; and the candidate The graphical indication of the string includes an indication of the particular additional symbol located at least partially above a character associated with a single key from the plurality of keys.

Clause 21. A system comprising means for performing any of the methods of clauses 1-8.

Clause 22. The computer readable storage medium of clause 15, comprising instructions that, when executed, further cause the at least one processor to perform any of the methods of clauses 1-8.

The computing device of clause 9, wherein the at least one module is further operative by the at least one processor to perform any of the methods of clauses 1-8.

In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted by the computer readable medium as one or more instructions or code and executed by a hardware-based processing unit. The computer readable medium may comprise: a computer readable storage medium corresponding to a tangible medium such as a data storage medium; or a communication medium comprising any medium that facilitates transmission of a computer program from one location to another, eg, according to a communication protocol . In this manner, the computer readable medium can generally be It should be: (1) a non-transitory tangible computer readable storage medium, or (2) a communication medium such as a signal or carrier. A data storage medium may be any available media that can be accessed by one or more computers or one or more processors to obtain instructions, code, and/or data structures for implementing the techniques described in this disclosure. The computer program product can include a computer readable medium.

Such computer readable storage medium can include RAM, ROM, EEPROM, CD-ROM, or other optical disk storage media, magnetic disk storage media, or other magnetic storage device, flash memory, or can be utilized by way of example and not limitation. Any other medium that stores the required program code in the form of an instruction or data structure and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if you use coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave to transmit commands from a website, server, or other remote source, then Axis cables, fiber optic cables, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are all included in the definition of the medium. It should be understood, however, that computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but are instead, non-transitory, tangible storage media. As used herein, a disk and a disc include a compact disc (CD), a laser disc, an optical disc, a digital versatile disc (DVD), a floppy disc, and a Blu-ray disc, wherein the disc typically reproduces data magnetically. And the optical disc uses a laser to optically reproduce data. Combinations of the above should also be included within the scope of computer readable media.

The instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), field programmable logic Array (FPGA), or other equivalent integrated or discrete logic. Accordingly, the term "processor" may be used to refer to the foregoing structure or any other structure suitable for implementing the described techniques. Moreover, in some aspects the described functionality may be provided within specialized hardware and/or software modules. Moreover, the technique can be implemented entirely in one or more circuits or logic elements.

The techniques of this disclosure may be implemented in a wide variety of devices or devices, including wireless handsets, integrated circuits (ICs), or groups of ICs (eg, a chipset). The present disclosure describes various components, modules, or units to emphasize functional aspects of devices configured to perform the disclosed techniques, but does not necessarily need to be implemented by different hardware units. Rather, as described above, various units may be combined in a hardware unit or provided by a collection of interoperative hardware units in combination with suitable software and/or firmware, including one or more of the ones described above. processor.

Various examples have been described. These and other examples are intended to fall within the scope of the appended claims.

Claims

A method comprising:

Outputting a graphical keyboard by the computing device for display;

Receiving, by the computing device, an indication of a gesture input selecting one or more keys of the graphical keyboard, wherein the indication of the gesture input includes pressure information associated with the gesture input;

A candidate string is determined by the computing device based at least in part on the indication of the gesture input, wherein the candidate string is associated with two or more additional symbol patterns, wherein the two or more At least one additional symbol style in the multiple additional symbol style includes at least one additional symbol;

Selecting, by the computing device, a particular additional symbol pattern from the two or more additional symbol styles based on the pressure information;

A graphical indication of the candidate character string is output by the computing device for display, wherein the graphical indication of the candidate character string includes an indication of the particular additional symbol pattern.
The method of claim 1, wherein the at least one of the at least one additional symbol pattern of the two or more additional symbol patterns indicates at least one of the four pinyin tones.
The method of claim 1 wherein selecting the particular additional symbol pattern comprises: based on whether a portion of the gesture input comprises: a constant pressure, an increasing pressure, a decreasing and increasing pressure, or a decreasing The pressure to select the particular additional symbol style.
The method of claim 3 wherein selecting the particular additional symbol pattern comprises:

Retrieving, by the computing device, a first additional symbol pattern comprising a constant tonal additional symbol in response to determining that the portion of the gesture input comprises a constant pressure;

Responsive to determining that the portion of the gesture input includes increasing pressure, a second additional symbol pattern including an upward tone-attached symbol is selected by the computing device;

Responsive to determining that the portion of the gesture input includes a decreasing and increasing pressure, a third additional symbol pattern comprising a downwardly-adjusted tonal additional symbol is selected by the computing device;

In response to determining that the portion of the gesture input includes decreasing pressure, a fourth additional symbol pattern including a downward tonal additional symbol is selected by the computing device.
The method of claim 3, wherein the portion of the gesture input is a first portion, the method further comprising: further determining whether the second portion of the gesture input comprises: constant pressure, increasing pressure The decreasing additional pressure, or decreasing pressure, selects the particular additional symbol pattern.
The method of claim 1 wherein selecting the particular additional symbol pattern from the two or more additional symbol styles comprises:

Determining, by the computing device, an amount of pressure change between the first portion of the gesture input and the second portion of the gesture input;

The particular additional symbol pattern is selected by the computing device from the two or more additional symbol styles based on the amount of pressure change.
The method of claim 1 wherein:

The pressure information is associated with a portion of the gesture input that selects a single key of the graphical keyboard;

The graphical indication of the candidate string includes the indication of the particular additional symbol pattern located at least partially above a character associated with the single key.
The method of claim 1 wherein:

The pressure information is associated with a portion of the gesture input that selects a plurality of keys of the graphical keyboard;

The graphical indication of the candidate string includes at least partially located and from the The indication of the particular additional symbol pattern above the character associated with a single key of the plurality of keys.
A computing device comprising:

At least one processor;

At least one module, the at least one module being operative by the at least one processor to:

Output a graphic keyboard for display;

Receiving an indication of a gesture input selecting one or more keys of the graphical keyboard;

A candidate character string is determined based at least in part on the indication of the gesture input, wherein the candidate character string is associated with two or more additional symbol styles, wherein the two or more additional symbol styles are At least one additional symbol style includes at least one additional symbol;

Selecting a particular additional symbol pattern from the two or more additional symbol styles based on pressure information associated with the indication of the gesture input;

A graphical indication of the candidate character string is output for display, wherein the graphical representation of the candidate character string includes an indication of the particular additional symbol pattern.
The computing device of claim 9, wherein the at least one of the at least one of the two or more additional symbol patterns indicates at least one of the four pinyin tones .
The computing device of claim 9 wherein:

The at least one module is further operative by the at least one processor to select based on whether a portion of the gesture input comprises: a constant pressure, an increasing pressure, a decreasing and increasing pressure, or a decreasing pressure The particular additional symbol style.
The computing device of claim 9, wherein the at least one module is further operative by the at least one processor to select the particular additional symbol pattern by at least the following operations:

Determining an amount of pressure change between the first portion of the gesture input and the second portion of the gesture input;

The particular additional symbol pattern is selected from the two or more additional symbol patterns based on the amount of pressure change.
The computing device of claim 9 wherein:

The pressure information is associated with a portion of the gesture input that selects a single key of the graphical keyboard;

The graphical indication of the candidate string includes the indication of the particular additional symbol pattern located at least partially above a character associated with the single key.
The computing device of claim 9 wherein:

The pressure information is associated with a portion of the gesture input that selects a plurality of keys of the graphical keyboard;

The graphical indication of the candidate string includes the indication of the particular additional symbol located at least partially above a character associated with a single key from the plurality of keys.
A computer readable storage medium encoded with instructions that, when executed, cause at least one processor of a computing device to:

Output a graphic keyboard for display;

Receiving an indication of a gesture input selecting one or more keys of the graphical keyboard, wherein the indication of the gesture input includes pressure information associated with the gesture input;

A candidate character string is determined based at least in part on the indication of the gesture input, wherein the candidate character string is associated with two or more additional symbol styles, wherein the two or more additional symbol styles are At least one additional symbol style includes at least one additional symbol;

Selecting a particular additional symbol pattern from the two or more additional symbol styles based on the pressure information;

A graphical indication of the candidate character string is output for display, wherein the graphical representation of the candidate character string includes an indication of the particular additional symbol pattern.
The computer readable storage medium of claim 15, wherein the at least one of the at least one of the two or more additional symbol patterns indicates at least one of the four pinyin tones A pinyin tone.
The computer readable storage medium of claim 15, wherein the instructions, when executed, further cause the at least one processor to select the particular additional symbol at least by: based on whether a portion of the gesture input is These include: a constant pressure, an increasing pressure, a decreasing and increasing pressure, or a decreasing pressure to select the particular additional symbol pattern.
A computer readable storage medium according to claim 15 wherein said instructions, when executed, further cause said at least one processor to select said particular addition from said two or more additional symbols by at least symbol:

Determining, by the computing device, an amount of pressure change between the first portion of the gesture input and the second portion of the gesture input;

The particular additional symbol pattern is selected by the computing device from the two or more additional symbol styles based on the amount of pressure change.
A computer readable storage medium according to claim 15 wherein:

The pressure information is associated with a portion of the gesture input that selects a single key of the graphical keyboard;

The graphical indication of the candidate string includes the indication of the particular additional symbol pattern located at least partially above a character associated with the single key.
A computer readable storage medium according to claim 15 wherein:

The pressure information is associated with a portion of the gesture input that selects a plurality of keys of the graphical keyboard;

The graphical indication of the candidate string includes the indication of the particular additional symbol located at least partially above a character associated with a single key from the plurality of keys.