CN110109600B - Multi-user-computer interaction element optimization input method and system based on touch screen - Google Patents
Multi-user-computer interaction element optimization input method and system based on touch screen Download PDFInfo
- Publication number
- CN110109600B CN110109600B CN201810102059.XA CN201810102059A CN110109600B CN 110109600 B CN110109600 B CN 110109600B CN 201810102059 A CN201810102059 A CN 201810102059A CN 110109600 B CN110109600 B CN 110109600B
- Authority
- CN
- China
- Prior art keywords
- key
- user
- intention
- pressure
- sliding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Abstract
A multi-user-computer interaction element optimization input method based on a touch screen judges the triggering intention of a user by tracking the track of the user in the sliding process and analyzing the characteristics in the track, dynamically adjusts the pressure sensitivity of each key according to the triggering intention, and adjusts the appearance of a virtual keyboard and the judgment range of the track according to the triggering intention, thereby realizing the optimization input. The method and the device can judge the intention of triggering the key in the sliding process of the user according to the changes of the sliding speed, the pressure and the like of the user, and design the mode of allowing the user to complete input by sliding a finger on the touch screen on the basis of the intention, so that the experience and the efficiency of Chinese input of the user on the touch screen device are improved.
Description
Technical Field
The invention relates to a technology in the field of computers, in particular to a multi-user-computer interaction element optimization input method and a multi-user-computer interaction element optimization input system based on a touch screen.
Background
The existing touch screen pinyin input mode is similar to the traditional keyboard-based pinyin input method, and some characteristics of touch screen equipment are not adjusted and optimized in a targeted mode. The touch screen equipment brings some problems to be solved for input method designers, but also provides more design directions and change spaces, the Chinese input method on the existing touch screen equipment is still a virtual keyboard input method based on the traditional physical keyboard design, and the characteristics of a plurality of touch screen equipment are not reflected in the design of the input method.
Disclosure of Invention
The invention provides a multi-user-computer interaction element optimization input method and system based on a touch screen, aiming at the defects in the prior art, combines some characteristics of touch screen equipment with a traditional Chinese input method, can judge the intention of triggering a key in the sliding process of a user according to the changes of the sliding speed, the pressure and the like of the user, designs the method on the basis of the intention, allows the user to complete input by sliding a finger on the touch screen, and improves the experience and the efficiency of the user in inputting Chinese on the touch screen equipment.
The invention is realized by the following technical scheme:
the invention judges the triggering intention of the user and dynamically adjusts the pressure sensitivity of each key according to the triggering intention by tracking the trajectory of the user in the sliding process and analyzing the characteristics in the trajectory, and simultaneously adjusts the appearance of the virtual keyboard and the judgment range of the trajectory according to the triggering intention, thereby realizing optimized input.
The analysis specifically comprises the following steps: periodically sampling the sliding track, and for the t-th sampling point (x) in the sliding processt，yt) I.e. the horizontal and vertical coordinates of the current sliding position on the screen, is calculated by (x)t，yt)，(xt-1，yt-1)，(xt+1，yt+1) The radius R of a circumscribed circle of a triangle formed by the three points is used as a standard for judging the triggering intention,
wherein:
in the analysis, when a plurality of continuous sampling points fall within the range of a certain key in the sliding process and the R value of more than one sampling point is greater than a set threshold value, after the finger of the user slides into a certain key area, the input method triggers the key at most once until the finger of the user leaves the key area, and the condition that the certain key is triggered for many times is avoided.
The analysis preferably introduces the touch pressure into the sliding behavior judgment, that is, adds a correction amount related to the pressure p when the user touches the screen to the variable R for judging the user's intention, and adds the pressure when the user touches the screen to R in a linear form to obtain an optimized judgment variable R' ═ R + α (p-q), wherein: α is a parameter for adjusting the degree of influence of the pressure, and q is a set standard pressure, and may be a global parameter for all sliding motions of the user, or may be individually set for each key or region. This design may also be used as a supplement or optimization to the aforementioned tracking and analysis of the sliding trajectory, and may also allow the user to activate certain keys by the pressure change of the finger touching the screen, for example, when the user wishes to activate a plurality of keys located approximately in a straight line, the touch pressure may be increased when the finger slides over the key desired to be activated, and the input method may activate the corresponding key by recognizing this feature.
The track is characterized in that: the starting and ending positions of the user's sliding trajectory should both be considered to be within the area of the key that the user wants to trigger because the user should take no extra action during the input process if he wishes to enter efficiently, one trajectory should be starting with the key corresponding to the first letter he wants to enter and ending with the key corresponding to the last letter he wants to enter.
The letters 'a', 'i', 'u', 'e', 'o' and 'v' which are high in use ratio in the Chinese pinyin input process are distributed on the edge position of the keyboard, and when the Chinese pinyin is input, the keys forming the legal pinyin syllable letters are often not on the same straight line, so that a user is likely to change the sliding direction at the key position which is expected to be triggered in the sliding process. Therefore, when analyzing the sliding track of the user, if it is assumed that the sliding process of the user is a nearly straight sliding between the keys that the user wants to trigger, the direction change of the sliding track is the factor that can most clearly reflect the user's intention to trigger a certain key.
The dynamic adjustment is as follows: the appearance layout of the virtual keyboard or the pressure threshold triggered by the keys is tentatively changed in the input process of the user, if the input speed of the user is increased after the adjustment is detected, the adjustment is encouraged, otherwise, corresponding punishment is carried out, and the input speed of the user can be gradually increased to a higher level after the long-term input and adjustment.
And the pressure sensitivity, namely the pressure threshold value triggered by the key, is judged to be that the key corresponding to the position where the finger is located is expected to be triggered when the pressure of the touch screen is higher than the value, otherwise, the key corresponding to the position where the finger is located is not expected to be triggered. By means of the design, the user can appropriately increase the pressure of the finger touching the screen when the finger reaches the position of the key which is expected to be started without changing the sliding habit or moderately relieving the sliding pressure when the finger slides between the keys which the user wishes to trigger, so that the input method can more likely recognize the intention of the user to trigger a certain key. Meanwhile, if the value of the standard pressure is set to be slightly higher than the average pressure of the user in the sliding process, the probability that the input method triggers the key which the user does not wish to trigger can be reduced.
The adjustment of the appearance of the virtual keyboard is as follows: for the key which may be expected to be triggered in the triggering intention, the width of the key is increased in the sliding direction, and the key is close to the position of the current finger. Preferably, in order to ensure the overall beauty and coordination of the virtual keyboard, and simultaneously reduce the probability of false touch due to the increase of the key area, the length and width of the keys are increased simultaneously in the actual layout adjustment.
The method for adjusting the appearance of the virtual keyboard comprises the following specific steps:
i) for each key kiA weight value w is obtained by calculationi；
ii) for each key kiThe length and width of the film are changed to the original (1+ d w)i) Multiplying, wherein d is a global variable used for determining the multiplying power of key scaling;
iii) enabling the predicted target key to approach to the position or the sliding direction of the finger of the user;
iv) according to the above method, k is assigned to each key during key position layout adjustmentiDetermine its weight wiAnd working out a corresponding key movement scheme. Input method in slidingIn the key layout adjustment, the size change of keys in a sliding target area of a user is mainly concerned, the key positions are properly finely adjusted according to the size change of the keys, and the key position change in a large range is not carried out, so that the key layout of the virtual keyboard is relatively close to the classical layout, and the user can conveniently prejudge the positions of the sliding target keys in the next step.
The invention relates to a system for realizing the method, which comprises the following steps: trajectory characteristic acquisition module, trigger intention analysis module, virtual keyboard adjustment module and button judgement module, wherein: the track characteristic acquisition module is connected with the trigger intention analysis module and transmits track information, the trigger intention analysis module is connected with the virtual keyboard adjustment module and transmits user intention information, the virtual keyboard adjustment module is connected with the key judgment module and transmits appearance control and pressure sensitivity information, and the key judgment module executes corresponding input operation.
Technical effects
Compared with the prior art, the method and the device can predict the target letter which is input by the user in the next step according to the current input and the sliding action of the user, dynamically adjust the pressure sensitivity of the keys, and adjust the keyboard layout according to the prediction result, thereby improving the input efficiency of the user; in addition, the invention allows the user to slide continuously on the touch screen without lifting the finger, and the user only needs to slide the finger over the key which is expected to be triggered, so that the input method can automatically trigger the key according to the sliding track of the user and the change of the moving speed, the pressure and the like of the touch point in the sliding process, thereby reducing the time spent by the user on lifting and falling the finger and improving the input efficiency. The invention can change the layout of the keys in real time in the input process of the user, including changing the size and the position of the keys and dynamically adjusting the pressure sensitivity of the keys, so that the user can reach the expected keys more quickly in the sliding process, thereby shortening the sliding time in the input process and improving the input efficiency.
Drawings
FIGS. 1 and 2 are schematic diagrams illustrating the effect of the keyboard in the embodiment;
fig. 3 and 4 are schematic diagrams illustrating effects of the embodiment.
Detailed Description
In this embodiment, the sliding input method is implemented in an Android operating system, and the touch data of the user including the number, position, and pressure during touch of touch points can be obtained from a related interface of the Android system. The Android 6.0 system is mounted on a device for specifically operating the input method, the resolution of a screen is 1920 x 1080, and the size of the screen is 5.2 inches.
In this embodiment, the method for reloading the corresponding methods in the InputMethodService class and the KeyboardView class which are defaulted by the Android operating system changes the behavior of the input method when the finger of the user slides on the screen, analyzes the behavior according to the touch data of the user obtained from the system interface, and judges and triggers the corresponding key by the method. In the process of converting pinyin to Chinese characters, an engine of a MoonPinyin input method is used, and the engine can generate a corresponding candidate word list according to a pinyin sequence input by a user and finish input by the user. The click input rule used as the comparison adopts the virtual keyboard key position layout and the 'Pinyin-Chinese character' conversion engine which are the same as those of the sliding input method.
In this embodiment, the sampling period of the touch point is adjusted to 10 milliseconds, the parameter of the touch point position in the formula is a pixel, the trigger threshold of the virtual key is 100, the pressure value is obtained by directly calling the getResure () function in the Android system MotionEvent, the α value is-50, and the q value is 0.9.
In this embodiment, the same parameters in the keyboard layout adjustment are used for all the keys, and the scaling factor w is set to 0.03, the key u that needs to be enlarged to meet the pinyin prediction result is set to 6, and the key v that needs to be reduced in the key area is set to-2.
As shown in fig. 1 and fig. 2, for two cases (the left diagram is "wei", the right diagram is "zhi") that the pinyin input can be completed without changing the direction, the present embodiment shows the performance of the keyboard in the use process by inputting the operation example of the pinyin sequence "jian": when "j" is entered, the next possible pinyins are "i" and "u"; when "jian" is input, the key which may be enlarged is only "g", and the predicted key is correspondingly enlarged in the embodiment shown in the figure.
The purpose of the experiment is to compare the input speed of the input method and should fit the input mode of the user in actual use as much as possible. FIG. 3 is a comparison of the average time spent entering each letter for three input modes when entering phrases of different Pinyin syllable lengths.
FIG. 4 is a comparison of the average time spent entering each letter for the three input methods when entering phrases of different Pinyin syllable lengths is the fastest. Through observation of experimental results, it can be found that, in the minimum average per-letter input time of most words or phrases, compared with the common click-type Chinese input method with a virtual keyboard touch screen, the sliding input method has more excellent performance, and the design idea is consistent with that the sliding input method can improve the input speed by reducing the time consumed by rising and falling of the fingers of a user. After the function of adjusting the key layout in real time is added, for most phrases, the minimum input time and the average input time of the user are reduced, which shows that the function actually accelerates the input speed of the user and improves the accuracy of meaning judgment in the sliding process of the user.
It is also noted that the longest average input time per letter of a part of words or phrases is longer than that of the clicking input when the sliding input method is used for inputting, which is mainly characterized in that the sliding input method has the effect of error recognition of the user intention, and once the recognition or input is wrong, the returning modification can greatly increase the time consumed in the input process of the user. The multi-element optimization sliding input method added with the dynamic pressure sensitivity adjustment effectively solves the problem.
The foregoing embodiments may be modified in many different ways by those skilled in the art without departing from the spirit and scope of the invention, which is defined by the appended claims and all changes that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Claims (1)
1. An input method of a multi-user-computer interaction element optimization input system based on a touch screen is characterized in that the system comprises: trajectory characteristic acquisition module, trigger intention analysis module, virtual keyboard adjustment module and button judgement module, wherein: the track characteristic acquisition module is connected with the trigger intention analysis module and transmits track information, the trigger intention analysis module is connected with the virtual keyboard adjustment module and transmits user intention information, the virtual keyboard adjustment module is connected with the key judgment module and transmits appearance control and pressure sensitivity information, and the key judgment module executes corresponding input operation;
the input method judges the triggering intention of the user by tracking the track of the user in the sliding process and analyzing the characteristics in the track, dynamically adjusts the pressure sensitivity of each key according to the triggering intention, and simultaneously adjusts the appearance of the virtual keyboard and the judging range of the track according to the triggering intention, thereby realizing optimized input;
the analysis specifically comprises the following steps: periodically sampling the sliding track, and for the t-th sampling point (x) in the sliding processt，yt) I.e. the horizontal and vertical coordinates of the current sliding position on the screen, is calculated by (x)t，yt)，(xt-1，yt-1)，(xt+1，yt+1) The radius R of a circumscribed circle of a triangle formed by the three points is used as a standard for judging the triggering intention,
wherein:
in the analysis, when a plurality of continuous sampling points fall within the range of a certain key in the sliding process and the R value of more than one sampling point is greater than a set threshold value, after the finger of a user slides into a certain key area, the input method triggers the key at most once until the finger of the user leaves the key area, so that the condition that the certain key is triggered for many times is avoided;
the analysis introduces the touch pressure into the sliding behavior judgment, namely adding a correction quantity related to the pressure p when the user touches the screen into a variable R for judging the intention of the user, and adding the pressure when the user touches the screen into R in a linear form to obtain an optimized judgment variable R' ═ R + alpha (p-q), wherein: alpha is a parameter for adjusting the influence degree of the pressure, and q is a set standard pressure;
when the pressure of the touch screen is higher than the value, the pressure sensitivity, namely the pressure threshold triggered by the key is judged to be that the key corresponding to the position where the finger is located is expected to be triggered, otherwise, the pressure sensitivity is judged to be that the key corresponding to the position where the finger is located is not expected to be triggered;
the adjustment of the appearance of the virtual keyboard is as follows: for the key which is possibly expected to be triggered in the triggering intention, the width of the key is increased in the sliding direction, and the key is close to the position of the current finger;
in order to ensure the overall beauty and coordination of the virtual keyboard, and simultaneously reduce the probability of false touch because of increasing the area of the keys, the length and the width of the keys are increased simultaneously in the actual layout adjustment;
the method for adjusting the appearance of the virtual keyboard comprises the following specific steps:
i) for each key kiA weight value w is obtained by calculationi；
ii) for each key kiThe length and width of the film are changed to the original (1+ d w)i) Multiplying, wherein d is a global variable used for determining the multiplying power of key scaling;
iii) enabling the predicted target key to approach to the position or the sliding direction of the finger of the user;
iv) according to the above method, k is assigned to each key during key position layout adjustmentiDetermine its weight wiAnd working out a corresponding key movement scheme.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810102059.XA CN110109600B (en) | 2018-02-01 | 2018-02-01 | Multi-user-computer interaction element optimization input method and system based on touch screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810102059.XA CN110109600B (en) | 2018-02-01 | 2018-02-01 | Multi-user-computer interaction element optimization input method and system based on touch screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110109600A CN110109600A (en) | 2019-08-09 |
| CN110109600B true CN110109600B (en) | 2022-04-29 |
Family
ID=67483543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810102059.XA Active CN110109600B (en) | 2018-02-01 | 2018-02-01 | Multi-user-computer interaction element optimization input method and system based on touch screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110109600B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504585A (en) * | 2009-03-09 | 2009-08-12 | 广东威创视讯科技股份有限公司 | Sliding type input method of touch screen |
| CN103502915A (en) * | 2011-04-09 | 2014-01-08 | 上海触乐信息科技有限公司 | System and method for implementing sliding input of text based upon on-screen soft keyboard on electronic equipment |
| CN104007832A (en) * | 2013-02-25 | 2014-08-27 | 上海触乐信息科技有限公司 | Method for continuously inputting texts by sliding, system and equipment |
| CN104834402A (en) * | 2015-05-11 | 2015-08-12 | 上海交通大学 | Implementation method of self-adaption Chinese input method touch screen keyboard based on predication |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160005150A1 (en) * | 2012-09-25 | 2016-01-07 | Benjamin Firooz Ghassabian | Systems to enhance data entry in mobile and fixed environment |
-
2018
- 2018-02-01 CN CN201810102059.XA patent/CN110109600B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504585A (en) * | 2009-03-09 | 2009-08-12 | 广东威创视讯科技股份有限公司 | Sliding type input method of touch screen |
| CN103502915A (en) * | 2011-04-09 | 2014-01-08 | 上海触乐信息科技有限公司 | System and method for implementing sliding input of text based upon on-screen soft keyboard on electronic equipment |
| CN104007832A (en) * | 2013-02-25 | 2014-08-27 | 上海触乐信息科技有限公司 | Method for continuously inputting texts by sliding, system and equipment |
| CN104834402A (en) * | 2015-05-11 | 2015-08-12 | 上海交通大学 | Implementation method of self-adaption Chinese input method touch screen keyboard based on predication |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110109600A (en) | 2019-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Nesbat | A system for fast, full-text entry for small electronic devices | |
| US7487461B2 (en) | System and method for issuing commands based on pen motions on a graphical keyboard | |
| US8599157B2 (en) | Techniques for recognizing a series of touches with varying intensity or angle of descending on a touch panel interface | |
| US7057607B2 (en) | Application-independent text entry for touch-sensitive display | |
| KR101061317B1 (en) | Alphabet text input method and device | |
| US9471220B2 (en) | Posture-adaptive selection | |
| JP4527731B2 (en) | Virtual keyboard system with automatic correction function | |
| US9632698B2 (en) | Operation control device, operation control method and computer program | |
| EP2756369B1 (en) | Soft keyboard interface | |
| US20050190973A1 (en) | System and method for recognizing word patterns in a very large vocabulary based on a virtual keyboard layout | |
| WO2010010350A1 (en) | Data input system, method and computer program | |
| EP2336852A2 (en) | Gesture-based repetition of key activations on a virtual keyboard | |
| JP2006524955A (en) | Unambiguous text input method for touch screen and reduced keyboard | |
| WO2017133697A1 (en) | Method and device for use in secondary text input | |
| JP2015200948A (en) | System and method for entering one or more inputs associated with multi-input targets | |
| Zhang et al. | Gedit: Keyboard gestures for mobile text editing | |
| CN110109600B (en) | Multi-user-computer interaction element optimization input method and system based on touch screen | |
| Ward | Adaptive computer interfaces | |
| CN111124222B (en) | Input switching method and device, electronic equipment and storage medium | |
| TW201403383A (en) | Multilanguage stroke input system | |
| Gu et al. | To write not select, a new text entry method using joystick | |
| CN111078028A (en) | Input method, related device and readable storage medium | |
| Burgbacher et al. | Modeling human performance of stroke-based text entry | |
| Bi et al. | Soft Keyboard Performance Optimization | |
| Burgbacher et al. | Synthetic Word Gesture Generation for Stroke-Based Virtual Keyboards |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |